-- Logs begin at Sun 2022-06-26 02:17:15 UTC, end at Sun 2022-06-26 03:32:20 UTC. -- Jun 26 02:56:17.181310 dv-cinder-846842-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 26 02:56:17.190084 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 26 02:56:17.192021 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jun 26 02:56:17 2022] *** Jun 26 02:56:17.192021 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 26 02:56:17.192021 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 26 02:56:17.192021 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: nodename: dv-cinder-846842-4-iscsi Jun 26 02:56:17.192021 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: machine: x86_64 Jun 26 02:56:17.192021 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: clock source: unix Jun 26 02:56:17.192021 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: pcre jit disabled Jun 26 02:56:17.192021 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: detected number of CPU cores: 4 Jun 26 02:56:17.192021 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: current working directory: / Jun 26 02:56:17.192021 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: detected binary path: /usr/bin/uwsgi-core Jun 26 02:56:17.192702 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: your processes number limit is 47680 Jun 26 02:56:17.192702 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: your memory page size is 4096 bytes Jun 26 02:56:17.192702 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: detected max file descriptor number: 2048 Jun 26 02:56:17.192702 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: lock engine: pthread robust mutexes Jun 26 02:56:17.192702 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: thunder lock: enabled Jun 26 02:56:17.192702 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 26 02:56:17.192702 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 26 02:56:17.235828 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: Python main interpreter initialized at 0x561f2a6799c0 Jun 26 02:56:17.235828 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: python threads support enabled Jun 26 02:56:17.235828 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: your server socket listen backlog is limited to 100 connections Jun 26 02:56:17.235828 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: your mercy for graceful operations on workers is 90 seconds Jun 26 02:56:17.236181 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: mapped 403077 bytes (393 KB) for 2 cores Jun 26 02:56:17.236253 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: *** Operational MODE: preforking *** Jun 26 02:56:17.236493 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: *** uWSGI is running in multiple interpreter mode *** Jun 26 02:56:17.236493 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: spawned uWSGI master process (pid: 103262) Jun 26 02:56:17.236677 dv-cinder-846842-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 26 02:56:17.239257 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: spawned uWSGI worker 1 (pid: 103263, cores: 1) Jun 26 02:56:17.239257 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: spawned uWSGI worker 2 (pid: 103264, cores: 1) Jun 26 02:56:17.239257 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 26 02:56:17.892251 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 26 02:56:17.894001 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 26 02:56:19.011246 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 26 02:56:19.011246 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: from cryptography.utils import int_from_bytes Jun 26 02:56:19.011822 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 26 02:56:19.011822 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: from cryptography.utils import int_from_bytes Jun 26 02:56:19.012426 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 26 02:56:19.012426 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: from cryptography.utils import int_from_bytes Jun 26 02:56:19.012426 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 26 02:56:19.012426 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: from cryptography.utils import int_from_bytes Jun 26 02:56:21.483195 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 26 02:56:21.483764 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 26 02:56:21.483981 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 26 02:56:21.484341 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 26 02:56:21.484598 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 26 02:56:21.484981 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.485308 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.485628 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.485947 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.486158 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 26 02:56:21.486546 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.486635 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 26 02:56:21.486724 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.486907 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.486991 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 26 02:56:21.487221 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.487306 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 26 02:56:21.487521 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 26 02:56:21.487602 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.487795 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.487887 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.488108 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.488209 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.488433 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-4-iscsi {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.488541 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.488748 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.488848 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.489054 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.489147 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.489361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.489454 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.489673 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.489765 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.489974 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.490084 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.490898 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.490995 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.491158 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.491275 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.491472 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.491776 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.491884 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-4-iscsi {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.492101 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.492211 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.492405 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.492515 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.492710 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.492822 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.493024 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.493195 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.493344 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.493427 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.493631 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.493720 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.493934 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.494018 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.494346 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.494486 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.494660 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.494856 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.494951 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.495089 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.495345 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-4-iscsi {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.495430 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.495661 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.495747 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.495971 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.496114 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.496282 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.496373 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.496601 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.496735 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.496906 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.497000 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.497225 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.497304 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.497531 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.497615 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.497913 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.498014 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-4-iscsi {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.498249 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.498388 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.498560 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.498655 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.498869 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.498961 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.499186 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.499534 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.499769 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.499862 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.500071 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.500155 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.500379 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.500465 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.500687 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.500771 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.501008 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.501092 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.501312 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.501398 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.501615 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.501700 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.501864 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.501956 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.502211 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.502302 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.502520 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.502611 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.502837 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.502934 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.503147 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.503231 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.503396 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.503481 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.503645 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.503738 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.503967 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.504052 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.504270 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.504359 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.504576 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.504706 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.504882 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.504965 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.505189 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.505273 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.505496 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.505595 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.505743 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.505826 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.506019 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.506182 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.506359 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.506446 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.506676 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.506760 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.506982 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.507075 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.507285 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.507390 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.507590 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.507680 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.507893 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.507986 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.508199 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.508289 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.508504 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.508604 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.508807 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.508893 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.509110 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.509194 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.509423 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.509507 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.509735 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.509827 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.510074 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.510160 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.510381 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.510476 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.510699 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.510784 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.511003 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.511094 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.511308 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.511393 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.511613 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.511699 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.511934 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.512019 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.512247 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.512336 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.512553 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.512645 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.512799 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.512881 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.513098 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.513194 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.513401 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.513486 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.513715 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.513798 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.514028 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.514143 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.514359 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.514443 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.514663 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.514791 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.514963 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.515061 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.515209 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.515292 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.515506 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.515597 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.515809 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.515901 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.516124 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.516208 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.516426 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.516517 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.516726 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.516812 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.517026 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.517114 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.517323 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.517407 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.517622 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.517705 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.517923 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.518006 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.518252 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.518338 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.518555 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.518641 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.518859 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.518951 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.519155 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.519239 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.519457 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.519550 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.519757 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.519894 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.520057 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.520148 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.520359 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.520443 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.520669 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.520751 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.520971 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.521061 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.521281 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.521371 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.521594 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.521691 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.521899 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.521990 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.522242 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.522330 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.522547 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.522638 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.522843 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.522926 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.523148 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.523234 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.523448 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.523532 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.523750 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.523842 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.524057 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.524142 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.524358 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.524447 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.524658 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.524748 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.524961 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.525126 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.525260 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.525387 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.525543 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.525681 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.525842 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.525971 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.526166 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.526310 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.526467 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.526603 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.526750 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.526893 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.527051 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.527180 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.527351 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.527480 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.527651 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.527781 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.527950 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.528098 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.528252 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.528389 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.528530 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.528682 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.528831 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.528961 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.529132 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.529268 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.529436 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.529564 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.529740 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.529868 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.530059 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.530214 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.530377 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:56:21.530508 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.530708 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.530855 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.531042 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.531173 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.531384 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.531524 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.531692 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.531833 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.532003 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.532139 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.532322 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.532452 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.532633 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.532779 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.532945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.533074 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.533256 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.533385 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.533571 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.533707 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.533876 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.534023 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.534213 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.534358 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.534499 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.534642 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.534813 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.534943 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.535131 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.535260 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.535438 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.535580 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.535753 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.535890 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.536067 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.536196 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.536381 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.536518 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.536691 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.536821 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.537005 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.537627 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.537835 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.537970 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.538221 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.538351 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.538534 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.538664 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.538856 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.538999 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.539185 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.539325 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.539498 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.539634 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.539812 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.539943 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.540124 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.540251 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.540431 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.540525 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.540738 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.540822 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.541045 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.541129 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.541351 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.541444 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.541683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.541767 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.541994 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.542127 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.542333 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.542427 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.542643 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.542727 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.542956 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.543041 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.543264 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.543360 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.543571 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.543655 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.543880 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.543966 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.544184 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.544270 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.544494 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.544579 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.544797 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.544888 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.545104 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.545191 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.545406 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.545491 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.545715 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.545797 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.546028 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.546185 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.546354 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.546438 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.546657 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.546742 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.546962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.547048 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.547266 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.547351 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.547574 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.547668 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.547875 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.547967 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.548177 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.548305 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.548489 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.548584 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.548795 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.548921 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.549097 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.549180 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.549419 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.549511 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.549725 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.549809 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.550029 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.550182 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.550359 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.550452 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.550664 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.550755 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.550967 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.551052 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.551276 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.551369 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.551582 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.551665 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.551890 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.551976 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.552197 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.552288 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.552501 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.552585 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.553365 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.553461 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.553677 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.553776 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.553984 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.554089 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.554326 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.554422 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.554636 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.554723 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.554947 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.555033 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.555260 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.555345 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.555571 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.555658 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.555893 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.555985 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.556208 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.556301 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.556520 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.556607 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.556830 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.556920 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.557135 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.557227 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.557437 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.557522 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.557744 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.557837 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.558089 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.558192 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.558374 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.558459 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.558678 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.558770 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.558982 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.559075 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.559284 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.559375 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.559583 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.559666 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.559885 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.559971 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.560183 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.560267 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.560483 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.560565 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.560783 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.560868 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.561080 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.561171 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.561387 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.561473 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.561688 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.561774 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.562006 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.562122 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.562335 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.562429 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.562636 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.562723 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.562938 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.563023 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.563241 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.563333 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.563578 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.563670 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.563879 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.563964 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.564189 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.564279 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.564507 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.564591 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.564827 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.564912 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.565138 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.565231 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.565448 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.565534 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.565754 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.565844 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.566081 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.566183 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.566397 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.566481 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.566704 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.566788 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.567007 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.567093 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.567319 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.567404 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.567626 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.567709 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.567945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.568031 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.568254 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.568360 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.568601 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.568690 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.568909 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.568994 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.569223 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.569318 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.569524 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.569608 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.569831 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.569916 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.570166 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.570269 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.570481 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.570580 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.570801 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.570886 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.571113 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.571197 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.571430 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.571526 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.571738 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.571831 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.572044 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.572127 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.572353 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.572445 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.572660 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.572743 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.572962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.573046 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.573274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.573371 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.573582 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.573665 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.573899 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.573991 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.574233 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.574330 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.574549 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.574633 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.574854 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.574939 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.575168 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.575253 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.575469 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.575554 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.575777 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.575861 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.576082 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.576169 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.576387 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.576479 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.576696 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.576781 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.577008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.577093 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.577315 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.577398 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.577626 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.577709 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.577929 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.578013 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.578263 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.578348 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.578569 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.578665 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.578873 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.578957 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.579177 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.579261 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.579489 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.579580 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.579799 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.579884 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.580108 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.580191 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.580409 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.580500 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.580722 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.580815 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.581027 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.581110 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.581330 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.581423 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.581632 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.581717 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.581945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.582029 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.582275 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.582363 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.582580 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.582665 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.582884 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.582969 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.583207 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.583294 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.583513 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.583610 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.583815 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.583900 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.584159 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.584247 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.584467 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.584557 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.584773 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.584859 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.585077 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.585163 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.585380 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.585464 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.585686 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.585790 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.586008 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.586148 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.586333 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.586417 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.586645 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.586741 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.586958 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.587045 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.587264 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.587346 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.587572 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.587663 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.587879 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.587962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.588186 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.588279 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.588498 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.588591 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.588811 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.588902 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.589120 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.589204 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.589428 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.589517 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.589736 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.589820 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.590064 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.590164 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.590379 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.590636 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.590730 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.590973 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.591058 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.591291 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.591388 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.591607 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.591693 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.591911 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.591997 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.592222 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.592316 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.592540 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.592625 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.592867 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.593101 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.593217 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.593442 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.593603 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.593764 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.593849 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.594109 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.594199 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.594436 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.594534 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.594750 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.594834 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.595056 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.595141 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.595364 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.595451 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.595668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.595753 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.595977 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.596073 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.596280 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.596365 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.596584 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.596671 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.596888 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.596979 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.597192 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.597285 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.597495 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.597587 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.597795 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.597879 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.598125 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.598224 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.598430 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.598515 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.598731 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.598814 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.599034 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.599128 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.599335 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.599465 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.600158 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.600251 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.600459 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.600556 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.600764 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.600851 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.601075 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.601160 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.601378 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.601465 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.601699 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.601785 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.602013 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.602166 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.602341 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.602432 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.602647 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.602744 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.602950 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.603044 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.603292 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.603379 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.603597 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.603681 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.603902 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.603994 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.604213 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.604298 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.604523 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.604617 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.604824 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.604919 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.605140 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.605225 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.605446 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.605540 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.605757 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.605864 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.606078 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.606167 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.606385 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.606470 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.606694 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.606791 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.606994 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.607087 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.607294 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.607379 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.607601 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.607694 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.607903 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.607989 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.608208 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.608299 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.608515 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.608599 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.608815 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.608951 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.609114 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.609199 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.609413 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.609548 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.609713 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.609799 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.610020 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.610165 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.610346 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.610439 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.610648 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.610767 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.610952 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.611046 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.611255 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.611347 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.611557 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.611651 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.611855 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.611947 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.612161 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.612245 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.612472 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.612562 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.612772 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.612865 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.613073 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.613157 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.613373 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.613458 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.613676 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.613769 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.613979 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.614095 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.614303 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.614388 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.614624 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.614719 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.614934 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.615019 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.615287 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.615883 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.616109 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.616215 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.616422 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.616528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.616722 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.616812 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.617022 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.617108 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.617329 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.617414 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.617634 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.617722 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.617941 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.618027 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.618270 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.618369 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.618573 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.618666 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.618876 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.619007 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.619181 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.619273 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.619487 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.619581 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.619803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.619895 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.620083 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.620176 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.620384 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.620548 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.620684 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.620768 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.620988 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.621090 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.621287 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.621380 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.621608 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.621693 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.621922 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.622006 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.622254 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.622342 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.622559 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.622646 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.622863 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.622948 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.623189 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.623274 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.623494 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.623579 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.623810 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.623895 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.624121 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.624208 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.624697 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.624782 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.625007 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.625092 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.625311 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.625397 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.625620 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.625702 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.625929 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.626012 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.626258 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.626346 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.626576 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.626660 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.626886 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.626986 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.627202 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.627294 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.627503 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.627593 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.627802 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.627896 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.628108 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.628192 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.628416 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.628501 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.628724 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.628816 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.629028 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.629111 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.629338 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.629423 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.629648 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.629745 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.629949 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.630035 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.630281 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.630378 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.630590 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.630675 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.630920 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.631009 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.631231 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.631317 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.631552 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.631639 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.631839 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.631923 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.632156 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.632242 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.632464 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.632549 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.632766 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.632859 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.633075 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.633174 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.633377 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.633464 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.633685 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.633776 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.633984 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.634114 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.634315 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.634431 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.634641 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.634766 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.634952 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.635047 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.635259 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.635354 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.635567 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.635652 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.635871 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.635969 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.636201 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.636332 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.636488 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.636573 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.636815 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.636907 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.637207 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.637292 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.637519 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.637604 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.637824 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.637918 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.638155 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.638254 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.638459 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.638551 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.638761 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.638848 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.639073 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.639194 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.639377 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.639470 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.639682 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.639792 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.639985 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.640104 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.640287 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.640417 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.640605 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.640727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.640906 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.641029 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.641225 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.641317 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.641630 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.641723 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.641938 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.642022 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.642268 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.642363 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.642571 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.642681 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.642873 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.642990 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.643193 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.643291 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.643497 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.643592 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.643815 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.643900 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.644215 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.644307 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.644522 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.644607 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.644824 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.644907 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.645135 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.645226 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.645458 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.645542 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.645780 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.645953 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.646113 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.646203 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.646429 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.646543 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.646757 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.646844 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.647077 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.647162 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.647387 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.647473 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.647696 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.647789 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.648012 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.648096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.648332 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.648423 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.648643 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.648727 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.648956 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.649049 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.649262 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.649348 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.649581 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.649669 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.649904 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.650007 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.650243 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.650328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.650552 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.650637 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.650857 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.650953 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.651162 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.651270 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.651480 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.651575 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.651784 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.651878 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.652093 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.652186 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.652404 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.652497 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.652709 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.652804 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.653013 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.653108 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.653317 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.653404 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.653634 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.653722 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.653935 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.654020 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.654278 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.654373 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.654589 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.654677 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.654900 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.654986 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.655209 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.655295 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.655510 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.655596 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.655811 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.655894 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.656124 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.656209 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.656425 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.656554 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.656726 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.656814 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.657029 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.657123 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.657350 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.657436 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.657660 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.657753 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.657963 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.658079 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.658309 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.658396 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.658618 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.658704 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.658924 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.659026 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.659229 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.659316 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.659533 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.659627 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.659866 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.660025 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.660167 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.660251 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.660485 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.660571 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.660788 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.660874 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.661091 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.661176 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.661400 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.661490 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.661705 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.661792 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.662009 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.662648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.662858 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.662945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.663182 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.663278 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.663471 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.663557 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.663774 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.663858 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.664077 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.664164 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.664385 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.664470 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.664687 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.664779 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.664987 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.665116 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.665287 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.665380 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.665596 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.665691 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.665897 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.665981 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.666225 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.666324 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.666527 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.666665 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.666849 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.666935 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.667153 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.667251 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.667475 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.667569 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.667784 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.667870 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.668089 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.668175 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.668392 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.668479 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.668693 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.668779 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.669014 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.669099 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.669323 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.669409 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.669638 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.669731 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.669952 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.670065 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.670292 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.670380 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.670606 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.670700 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.670913 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.670997 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.671219 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.671303 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.671533 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.671626 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.671845 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.671938 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.672159 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.672255 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.672478 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.672677 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.672793 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.673005 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.673091 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.673319 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.673403 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.673630 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.673714 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.673941 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.674029 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.674281 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.674367 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.674595 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.674691 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.674905 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.675133 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.675218 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.675464 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.675556 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.675779 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.675872 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.676092 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.676178 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.676404 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.676489 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.676718 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.676805 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.677031 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.677117 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.677341 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.677426 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.677652 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.677779 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.678529 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.678621 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.678881 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.678981 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.679212 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.679309 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.679540 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.679625 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.679850 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.679952 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.680164 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.680258 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.680481 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.680574 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.680795 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.680880 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.681106 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.681190 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.681420 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.681550 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.681732 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.681818 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.682061 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.682164 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.682381 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.682495 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.682694 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.682780 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.683008 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.683094 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.683324 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.683416 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.683638 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.683724 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.683951 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.684037 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.684264 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.684359 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.684578 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.684663 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.684888 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.684981 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.685201 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.685291 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.685517 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.685724 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.685833 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.686053 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.686180 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.686394 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.686515 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.686720 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.686858 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.687046 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.687141 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.687364 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.687450 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.687684 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.687770 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.688010 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.688238 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.688324 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.688553 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.688639 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.688885 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.688989 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.689202 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.689287 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.689507 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.689593 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.689827 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.689997 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.690159 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.690245 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.690465 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.690551 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.690778 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.690876 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.691084 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.691169 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.691395 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.691618 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.691702 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.691963 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.692062 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.692282 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.692374 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.692602 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.692694 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.692908 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.693001 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.693230 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.693322 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.693561 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.693654 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.693887 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.694111 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.694215 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.694457 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.694543 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.694774 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.694867 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.695101 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.695186 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.695412 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.695507 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.695717 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.695805 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.696023 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.696109 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.696331 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.696424 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.696635 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.696729 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.696938 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.697025 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.697239 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.697333 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.697549 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.697640 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.697854 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.697946 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.698181 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.698285 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.698488 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.698573 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.698794 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.698877 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.699097 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.699194 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.699402 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.699497 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.699701 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.699832 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.700003 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.700090 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.700314 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.700402 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.700613 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.700698 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.700918 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.701011 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.701218 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.701311 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.701521 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.701612 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.701821 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.701914 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.702149 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.702249 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.702460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.702546 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.702771 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.702865 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.703075 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.703161 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.703383 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.703476 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.703685 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.703769 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.703992 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.704082 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.704291 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.704384 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.704598 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.704683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.704905 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.704989 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.705253 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.705346 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.705557 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.705652 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.705857 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.706111 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.706198 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.706449 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.706536 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.706768 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.706854 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.707105 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.707206 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.707415 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.707501 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.707728 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.707823 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.708033 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.708133 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.708338 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.708575 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.708668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.708910 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.709017 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.709256 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.709352 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.709579 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.709664 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.709892 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.709990 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.710223 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.710312 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.710530 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.710615 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.710834 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.710931 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.711140 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.711232 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.711450 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.711536 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.711758 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.711851 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.712063 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.712155 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.712371 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.712455 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.712674 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.712771 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.712982 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.713067 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.713290 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.713376 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.713600 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.713686 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.713909 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.713994 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.714243 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.714334 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.714552 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.714638 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.714860 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.714946 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.715166 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.715250 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.715476 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.715584 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.715785 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.715882 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.716099 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.716194 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.716421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.716505 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.716731 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.716815 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.717037 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.717183 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.717344 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.717450 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.717652 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.717762 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.717960 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.718096 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.718295 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.718413 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.718611 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.718722 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.718938 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.719034 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.719250 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.719336 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.719553 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.719639 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.719952 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.720038 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.720262 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.720345 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.720581 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.720666 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.720900 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.720986 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.721209 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.721295 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.721528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.721621 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.721830 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.721921 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.722159 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.722249 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.722466 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.722571 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.722775 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.722861 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.723092 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.723176 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.723400 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.723493 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.723705 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.723790 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.724010 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.724101 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.724321 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.724408 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.725134 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.725227 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.725437 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.725521 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.725742 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.725893 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.726075 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.726181 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.726373 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.726458 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.726673 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.726759 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.726973 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.727058 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.727274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.727367 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.727574 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.727667 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.727875 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.727960 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.728176 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.728268 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.728480 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.728567 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.728782 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.728867 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.729078 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.729170 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.729378 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.729462 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.729677 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.729762 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.729978 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.730135 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.730305 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.730398 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.730610 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.730700 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.730919 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.731013 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.731223 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.731316 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.731527 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.731613 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.731829 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.731916 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.732132 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.732226 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.732432 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.732526 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.732767 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.732854 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.733078 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.733162 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.733432 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.733525 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.733709 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.733804 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.734018 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.734149 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.734354 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.734439 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.734660 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.734746 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.734970 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.735062 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.735280 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.735382 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.735590 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.735675 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.735901 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.736032 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.736234 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.736332 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.736541 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.736628 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.736852 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.736936 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.737164 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.737258 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.737476 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.737572 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.737784 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.737871 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.738116 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.738206 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.738445 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.738531 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.738756 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.738841 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.739064 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.739150 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.739377 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.739461 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.739690 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.739777 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.740004 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.740091 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.740865 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.740962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.741186 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.741282 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.741513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.741607 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.741824 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.741908 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.742160 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.742261 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.742481 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.742575 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.742797 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.742882 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.743117 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.743210 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.743434 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.743520 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.743750 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.743835 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.744075 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.744173 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.744390 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.744474 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.744695 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.744787 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.745000 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.745085 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.745243 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 26 02:56:21.745330 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.745660 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.745973 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.746342 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.746669 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.746985 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.747300 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.747606 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:56:21.747849 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 26 02:56:21.898847 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO dbcounter [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Registered counter for database nova_api Jun 26 02:56:21.900895 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO dbcounter [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] Registered counter for database nova_api Jun 26 02:56:21.920562 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_db.sqlalchemy.engines [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 02:56:21.922350 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 02:56:21.927214 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writer thread running {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 02:56:21.928872 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writer thread running {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 02:56:21.985359 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.context [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),025aa3fa-78c7-46e8-960a-ec1720423979(cell1) {{(pid=103263) load_cells /opt/stack/nova/nova/context.py:464}} Jun 26 02:56:21.986692 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.context [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),025aa3fa-78c7-46e8-960a-ec1720423979(cell1) {{(pid=103264) load_cells /opt/stack/nova/nova/context.py:464}} Jun 26 02:56:21.989254 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 02:56:21.990677 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 02:56:21.990971 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 02:56:21.991770 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 02:56:21.992265 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 02:56:21.993048 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 02:56:21.993720 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 02:56:21.995031 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 02:56:21.995714 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO dbcounter [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Registered counter for database nova_cell0 Jun 26 02:56:21.996993 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO dbcounter [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] Registered counter for database nova_cell0 Jun 26 02:56:22.000021 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO dbcounter [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Registered counter for database nova_cell1 Jun 26 02:56:22.001383 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO dbcounter [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] Registered counter for database nova_cell1 Jun 26 02:56:22.007196 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_db.sqlalchemy.engines [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 02:56:22.009324 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_db.sqlalchemy.engines [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 02:56:22.010386 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 02:56:22.012551 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 02:56:22.014814 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writer thread running {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 02:56:22.017038 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writer thread running {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 02:56:22.017508 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writer thread running {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 02:56:22.020271 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writer thread running {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 02:56:22.161952 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO dbcounter [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Registered counter for database nova_cell0 Jun 26 02:56:22.165770 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO dbcounter [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] Registered counter for database nova_cell0 Jun 26 02:56:22.169184 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_db.sqlalchemy.engines [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 02:56:22.172074 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 02:56:22.173601 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writer thread running {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 02:56:22.176372 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writer thread running {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 02:56:22.511625 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: WARNING keystonemiddleware.auth_token [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 26 02:56:22.518894 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: WARNING keystonemiddleware.auth_token [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 26 02:56:22.536972 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 26 02:56:22.546782 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 26 02:56:22.858155 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: WARNING keystonemiddleware.auth_token [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 26 02:56:22.864095 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: WARNING keystonemiddleware.auth_token [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 26 02:56:22.869896 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561f2a6799c0 pid: 103263 (default app) Jun 26 02:56:22.871994 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:56:22.873173 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Jun 26 02:56:22.873586 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Sun Jun 26 02:56:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:56:22.894307 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 26 02:56:22.900302 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-1d868b6b-0b7a-4135-957a-adf51017c22e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 26 02:56:22.905578 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561f2a6799c0 pid: 103264 (default app) Jun 26 02:57:37.219054 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:57:37.220067 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 26 02:57:37.220460 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:57:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:57:37.233051 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_api:SELECT=3 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:37.234229 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_cell0:SELECT=3 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:37.234984 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_cell1:SELECT=3 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:37.236306 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:37.661513 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-37e7556e-460c-40f9-b8e9-1e3ca0772ab4 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:57:37.690882 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-37e7556e-460c-40f9-b8e9-1e3ca0772ab4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.463026 Jun 26 02:57:37.691887 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1291 bytes} [Sun Jun 26 02:57:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 02:57:39.751471 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:57:39.752613 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-5248c547-a32f-421b-aa25-8052c5894744 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Jun 26 02:57:39.753099 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:57:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 02:57:39.812707 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ad70e928-3ca1-453a-a360-f7e52ec34a3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:39.834834 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 26 02:57:39.834834 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: warnings.warn(msg) Jun 26 02:57:39.864660 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ad70e928-3ca1-453a-a360-f7e52ec34a3b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104677 Jun 26 02:57:39.864784 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1282 bytes} [Sun Jun 26 02:57:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 02:57:39.880011 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writing DB stats nova_api:SELECT=3 {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:39.881049 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writing DB stats nova_cell1:SELECT=3 {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:39.882255 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writing DB stats nova_cell0:SELECT=3 {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:39.883061 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:40.090036 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-0c91b088-8b5a-41f0-9f55-5f80987751d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:40.092481 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 26 02:57:40.092481 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: warnings.warn(msg) Jun 26 02:57:40.157776 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-0c91b088-8b5a-41f0-9f55-5f80987751d9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284637 Jun 26 02:57:40.158864 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1335 bytes} [Sun Jun 26 02:57:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 02:57:42.251494 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ad70e928-3ca1-453a-a360-f7e52ec34a3b admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:57:42.253058 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ad70e928-3ca1-453a-a360-f7e52ec34a3b admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Jun 26 02:57:42.253708 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:57:42.371807 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-09f0ec0a-4d94-4f75-ae70-ff219e2652d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:42.389811 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 26 02:57:42.389811 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: warnings.warn(msg) Jun 26 02:57:42.410428 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-09f0ec0a-4d94-4f75-ae70-ff219e2652d2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150218 Jun 26 02:57:42.411001 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1282 bytes} [Sun Jun 26 02:57:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 02:57:42.423069 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-c20841b8-150a-430b-ae9a-6c31b1a7504a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:42.424573 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 26 02:57:42.424573 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: warnings.warn(msg) Jun 26 02:57:42.456201 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-c20841b8-150a-430b-ae9a-6c31b1a7504a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036922 Jun 26 02:57:42.457455 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1335 bytes} [Sun Jun 26 02:57:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 02:57:44.524281 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-09f0ec0a-4d94-4f75-ae70-ff219e2652d2 admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:57:44.525290 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-09f0ec0a-4d94-4f75-ae70-ff219e2652d2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 26 02:57:44.525855 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:57:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:57:44.584194 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-b192c888-5e44-4466-963a-652800967d7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "vcpus": 1, "ram": 1024, "id": "d2"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:44.602268 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-b192c888-5e44-4466-963a-652800967d7a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070861 Jun 26 02:57:44.603549 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1282 bytes} [Sun Jun 26 02:57:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 26 02:57:44.615677 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-12565306-a463-4047-8bed-c5e5fc1254fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:44.643421 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-12565306-a463-4047-8bed-c5e5fc1254fc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032078 Jun 26 02:57:44.644402 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1335 bytes} [Sun Jun 26 02:57:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 02:57:46.735507 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-b192c888-5e44-4466-963a-652800967d7a admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:57:46.736469 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-b192c888-5e44-4466-963a-652800967d7a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 26 02:57:46.736958 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:57:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:57:46.809830 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-246fa57d-5d3d-4092-9586-03d9bafc84aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:46.827794 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-246fa57d-5d3d-4092-9586-03d9bafc84aa admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085105 Jun 26 02:57:46.828534 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1282 bytes} [Sun Jun 26 02:57:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 26 02:57:46.840719 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-699cff78-f9a7-4216-9bed-e9e4ee0f61ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:46.868782 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-699cff78-f9a7-4216-9bed-e9e4ee0f61ce admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031678 Jun 26 02:57:46.869432 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1335 bytes} [Sun Jun 26 02:57:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 02:57:48.937975 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-246fa57d-5d3d-4092-9586-03d9bafc84aa admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:57:48.939231 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-246fa57d-5d3d-4092-9586-03d9bafc84aa admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 Jun 26 02:57:48.939726 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:57:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:57:48.998083 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-54a8f3e2-d066-4821-ab76-0ca741ab9073 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "vcpus": 4}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:49.016038 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-54a8f3e2-d066-4821-ab76-0ca741ab9073 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070596 Jun 26 02:57:49.016584 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1282 bytes} [Sun Jun 26 02:57:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 26 02:57:49.028803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-78d59601-c4ed-4caa-ab69-50b445a3ad06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:49.050907 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-78d59601-c4ed-4caa-ab69-50b445a3ad06 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025818 Jun 26 02:57:49.051443 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1335 bytes} [Sun Jun 26 02:57:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 02:57:51.148370 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-54a8f3e2-d066-4821-ab76-0ca741ab9073 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:57:51.149381 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-54a8f3e2-d066-4821-ab76-0ca741ab9073 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 26 02:57:51.149783 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:57:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:57:51.214726 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-8edddae1-5606-4397-9f41-eafd1bcfca69 admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:57:51.238252 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-8edddae1-5606-4397-9f41-eafd1bcfca69 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081844 Jun 26 02:57:51.238805 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1291 bytes} [Sun Jun 26 02:57:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 02:57:53.319836 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-54a8f3e2-d066-4821-ab76-0ca741ab9073 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:57:53.320847 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-54a8f3e2-d066-4821-ab76-0ca741ab9073 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 26 02:57:53.321248 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:57:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:57:53.382304 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-dbd53636-9117-4a07-a1ea-11ea84dc244d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:53.400149 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-dbd53636-9117-4a07-a1ea-11ea84dc244d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073019 Jun 26 02:57:53.400703 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1282 bytes} [Sun Jun 26 02:57:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 02:57:53.412575 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-aaa20aee-60b7-4088-9676-3c9e6ca037b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:53.435499 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-aaa20aee-60b7-4088-9676-3c9e6ca037b2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026745 Jun 26 02:57:53.436068 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1332 bytes} [Sun Jun 26 02:57:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 02:57:55.559554 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-dbd53636-9117-4a07-a1ea-11ea84dc244d admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:57:55.560683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-dbd53636-9117-4a07-a1ea-11ea84dc244d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jun 26 02:57:55.561105 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:57:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:57:55.629410 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-c6b01e3a-cb97-442a-a012-2a6b68828d9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "id": "2", "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:55.646720 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-c6b01e3a-cb97-442a-a012-2a6b68828d9f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079093 Jun 26 02:57:55.647262 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1282 bytes} [Sun Jun 26 02:57:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 26 02:57:55.659324 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-5c828e6f-1181-41e6-8777-03bb7731140f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:55.681987 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-5c828e6f-1181-41e6-8777-03bb7731140f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026484 Jun 26 02:57:55.682686 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1332 bytes} [Sun Jun 26 02:57:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 02:57:57.811480 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-c6b01e3a-cb97-442a-a012-2a6b68828d9f admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:57:57.812538 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-c6b01e3a-cb97-442a-a012-2a6b68828d9f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jun 26 02:57:57.812984 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:57:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:57:57.902686 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-78925d2b-02e5-4f7a-8eb8-6d45411955ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "ram": 4096}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:57.920724 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-78925d2b-02e5-4f7a-8eb8-6d45411955ab admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.101824 Jun 26 02:57:57.921365 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1282 bytes} [Sun Jun 26 02:57:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 02:57:57.937275 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-67d20e0b-4454-43bf-9b60-3c58a26a1e22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:57:57.971263 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-67d20e0b-4454-43bf-9b60-3c58a26a1e22 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040945 Jun 26 02:57:57.972448 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1332 bytes} [Sun Jun 26 02:57:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 02:58:00.021265 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-78925d2b-02e5-4f7a-8eb8-6d45411955ab admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:00.022302 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-78925d2b-02e5-4f7a-8eb8-6d45411955ab admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 26 02:58:00.022695 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:58:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:58:00.079196 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ead809d9-6a94-4ee2-bcf8-e81e222d6a0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "id": "4", "vcpus": 4, "ram": 8192}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:58:00.096536 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ead809d9-6a94-4ee2-bcf8-e81e222d6a0e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068254 Jun 26 02:58:00.097589 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1282 bytes} [Sun Jun 26 02:58:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 02:58:00.109597 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-53522577-afba-4281-b06b-27e643dedfc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:58:00.132560 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-53522577-afba-4281-b06b-27e643dedfc7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026865 Jun 26 02:58:00.133046 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1332 bytes} [Sun Jun 26 02:58:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 02:58:02.189991 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ead809d9-6a94-4ee2-bcf8-e81e222d6a0e admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:02.191544 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ead809d9-6a94-4ee2-bcf8-e81e222d6a0e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002019 Jun 26 02:58:02.192234 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:58:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 02:58:02.250485 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-12b387b8-52df-4ab7-9af9-201e8d845aa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "disk": 160, "os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:58:02.270671 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-12b387b8-52df-4ab7-9af9-201e8d845aa7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073042 Jun 26 02:58:02.271409 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1282 bytes} [Sun Jun 26 02:58:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 02:58:02.283356 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-929e1cbb-b43c-4d0b-b81c-f0395e70d256 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:58:02.307691 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-929e1cbb-b43c-4d0b-b81c-f0395e70d256 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028348 Jun 26 02:58:02.308299 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1332 bytes} [Sun Jun 26 02:58:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 02:58:27.237575 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-12b387b8-52df-4ab7-9af9-201e8d845aa7 admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:27.238774 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-12b387b8-52df-4ab7-9af9-201e8d845aa7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Jun 26 02:58:27.239249 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:58:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:58:27.250239 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:58:27.298876 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-f93e1a4f-24e0-408a-a901-36ff343995ab admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:27.320270 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-f93e1a4f-24e0-408a-a901-36ff343995ab admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074898 Jun 26 02:58:27.320804 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1291 bytes} [Sun Jun 26 02:58:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 02:58:28.231360 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-12b387b8-52df-4ab7-9af9-201e8d845aa7 admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:28.232369 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-12b387b8-52df-4ab7-9af9-201e8d845aa7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 26 02:58:28.232772 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Jun 26 02:58:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:58:28.418373 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-f1625ad0-ede0-44dc-86ec-34fe55cc1214 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:28.424060 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.wsgi [None req-f1625ad0-ede0-44dc-86ec-34fe55cc1214 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-f1625ad0-ede0-44dc-86ec-34fe55cc1214 admin admin] Request method failure captured: Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Accept: application/json Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Accept-Encoding: gzip, deflate Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Connection: keep-alive Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Content-Length: 0 Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Host: 10.222.0.13 Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Openstack-Api-Version: compute 2.90 Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Openstack-System-Scope: None Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: User-Agent: python-novaclient Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Auth-Token: gAAAAABit8tUNeSW3KCHtRAii97igXg_4adnJ9IfEL_ujY-2X2YHpY3FpxjEBBR4JAq0EEDZEaHi4ET8fOQTzELcdqRbhCxwsEzujQCb2TS-L275PpMBYHGjoZJc2vOaE0Ikf50ZyiSDUFOEQNG3HONLGqkjRRwj6SziZNtA8Pg-BuFiJIy5FNo Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Domain-Id: None Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Domain-Name: None Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Identity-Status: Confirmed Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Is-Admin-Project: True Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Openstack-Nova-Api-Version: 2.90 Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Project-Domain-Id: default Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Project-Domain-Name: Default Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Project-Id: becb24f8723f432e9a3c4c740a191a0b Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Project-Name: admin Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Role: member,reader,admin Jun 26 02:58:28.427945 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Roles: member,reader,admin Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/becb24f8723f432e9a3c4c740a191a0b"}]}] Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Tenant: admin Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Tenant-Id: becb24f8723f432e9a3c4c740a191a0b Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Tenant-Name: admin Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User: admin Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User-Domain-Id: default Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User-Domain-Name: Default Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User-Id: a05c37bdf694480a8a14de0b18b2da4b Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User-Name: admin Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: method: > Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: exception: Flavor 42 could not be found. Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: action_args: {'id': '42'} Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 02:58:28.429528 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 02:58:28.430648 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:28.432096 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-f1625ad0-ede0-44dc-86ec-34fe55cc1214 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 02:58:28.433429 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-f1625ad0-ede0-44dc-86ec-34fe55cc1214 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060703 Jun 26 02:58:28.433429 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Jun 26 02:58:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:28.438780 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-09ae1fb3-af5a-4ad3-99d8-6aa324d0a821 admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:28.441772 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:58:28.461060 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-09ae1fb3-af5a-4ad3-99d8-6aa324d0a821 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025804 Jun 26 02:58:28.461583 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Jun 26 02:58:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 02:58:28.470899 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-9b9e8cc3-acec-4d27-b128-535d48939749 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:28.494062 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-9b9e8cc3-acec-4d27-b128-535d48939749 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026618 Jun 26 02:58:28.494580 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Jun 26 02:58:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 02:58:28.503801 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-4ee88688-3929-4352-9825-1931da4d6099 admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:28.510136 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.wsgi [None req-4ee88688-3929-4352-9825-1931da4d6099 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-4ee88688-3929-4352-9825-1931da4d6099 admin admin] Request method failure captured: Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Accept: application/json Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Accept-Encoding: gzip, deflate Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Connection: keep-alive Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Content-Length: 0 Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Host: 10.222.0.13 Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Openstack-Api-Version: compute 2.90 Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Openstack-System-Scope: None Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: User-Agent: python-novaclient Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Auth-Token: gAAAAABit8tUNeSW3KCHtRAii97igXg_4adnJ9IfEL_ujY-2X2YHpY3FpxjEBBR4JAq0EEDZEaHi4ET8fOQTzELcdqRbhCxwsEzujQCb2TS-L275PpMBYHGjoZJc2vOaE0Ikf50ZyiSDUFOEQNG3HONLGqkjRRwj6SziZNtA8Pg-BuFiJIy5FNo Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Domain-Id: None Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Domain-Name: None Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Identity-Status: Confirmed Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Is-Admin-Project: True Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Openstack-Nova-Api-Version: 2.90 Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Project-Domain-Id: default Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Project-Domain-Name: Default Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Project-Id: becb24f8723f432e9a3c4c740a191a0b Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Project-Name: admin Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Role: member,reader,admin Jun 26 02:58:28.513361 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Roles: member,reader,admin Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/becb24f8723f432e9a3c4c740a191a0b"}]}] Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Tenant: admin Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Tenant-Id: becb24f8723f432e9a3c4c740a191a0b Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Tenant-Name: admin Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User: admin Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User-Domain-Id: default Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User-Domain-Name: Default Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User-Id: a05c37bdf694480a8a14de0b18b2da4b Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User-Name: admin Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: method: > Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: exception: Flavor 42 could not be found. Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: action_args: {'id': '42'} Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 02:58:28.514803 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 02:58:28.515649 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:28.516962 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-4ee88688-3929-4352-9825-1931da4d6099 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 02:58:28.518201 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-4ee88688-3929-4352-9825-1931da4d6099 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014524 Jun 26 02:58:28.518201 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Jun 26 02:58:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:29.344726 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-9b9e8cc3-acec-4d27-b128-535d48939749 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:29.345733 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-9b9e8cc3-acec-4d27-b128-535d48939749 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 26 02:58:29.346149 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Jun 26 02:58:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:58:29.533775 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-fca9ddc5-4d95-4c86-bb01-2e3a762d159e admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:29.541169 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.wsgi [None req-fca9ddc5-4d95-4c86-bb01-2e3a762d159e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-fca9ddc5-4d95-4c86-bb01-2e3a762d159e admin admin] Request method failure captured: Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Accept: application/json Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Accept-Encoding: gzip, deflate Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Connection: keep-alive Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Content-Length: 0 Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Host: 10.222.0.13 Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Openstack-Api-Version: compute 2.90 Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Openstack-System-Scope: None Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: User-Agent: python-novaclient Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Auth-Token: gAAAAABit8tVpBHTNawveyJZVR0xn6_8Q7EXTgGiZWvMR5DCN0_XVvND1Ofp0eAqaGXoWdnuf2W27l0veZxxSRrnk1qBzykFwa9oqaGTmRBUcNFyqiqXt8cvp3cO6LqxUc6Fml2E4pqGWGB4kniC3pMnHWImgFaq9j7GeeF-vfqV_BJCQPhpJC0 Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Domain-Id: None Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Domain-Name: None Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Identity-Status: Confirmed Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Is-Admin-Project: True Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Openstack-Nova-Api-Version: 2.90 Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Project-Domain-Id: default Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Project-Domain-Name: Default Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Project-Id: becb24f8723f432e9a3c4c740a191a0b Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Project-Name: admin Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Role: member,reader,admin Jun 26 02:58:29.542683 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Roles: member,reader,admin Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/becb24f8723f432e9a3c4c740a191a0b"}]}] Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Tenant: admin Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Tenant-Id: becb24f8723f432e9a3c4c740a191a0b Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Tenant-Name: admin Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User: admin Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User-Domain-Id: default Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User-Domain-Name: Default Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User-Id: a05c37bdf694480a8a14de0b18b2da4b Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User-Name: admin Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: method: > Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: exception: Flavor 84 could not be found. Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: action_args: {'id': '84'} Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 02:58:29.544190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 02:58:29.545207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:29.546477 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-fca9ddc5-4d95-4c86-bb01-2e3a762d159e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 02:58:29.547471 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-fca9ddc5-4d95-4c86-bb01-2e3a762d159e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062673 Jun 26 02:58:29.547471 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Jun 26 02:58:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:29.553992 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-7318c2e4-38d6-48fb-8d2e-11babfbbd51a admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:29.568128 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-7318c2e4-38d6-48fb-8d2e-11babfbbd51a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018214 Jun 26 02:58:29.568650 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Jun 26 02:58:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 02:58:29.577603 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-f5301e5a-9846-4ede-893c-c329d7b4ea77 admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:29.590936 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-f5301e5a-9846-4ede-893c-c329d7b4ea77 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016743 Jun 26 02:58:29.591442 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Jun 26 02:58:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 02:58:29.600185 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-c23c2e32-d4c1-410a-bb8d-2e71a9063990 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:29.605449 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.wsgi [None req-c23c2e32-d4c1-410a-bb8d-2e71a9063990 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-c23c2e32-d4c1-410a-bb8d-2e71a9063990 admin admin] Request method failure captured: Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Accept: application/json Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Accept-Encoding: gzip, deflate Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Connection: keep-alive Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Content-Length: 0 Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Host: 10.222.0.13 Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Openstack-Api-Version: compute 2.90 Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Openstack-System-Scope: None Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: User-Agent: python-novaclient Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Auth-Token: gAAAAABit8tVpBHTNawveyJZVR0xn6_8Q7EXTgGiZWvMR5DCN0_XVvND1Ofp0eAqaGXoWdnuf2W27l0veZxxSRrnk1qBzykFwa9oqaGTmRBUcNFyqiqXt8cvp3cO6LqxUc6Fml2E4pqGWGB4kniC3pMnHWImgFaq9j7GeeF-vfqV_BJCQPhpJC0 Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Domain-Id: None Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Domain-Name: None Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Identity-Status: Confirmed Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Is-Admin-Project: True Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Openstack-Nova-Api-Version: 2.90 Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Project-Domain-Id: default Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Project-Domain-Name: Default Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Project-Id: becb24f8723f432e9a3c4c740a191a0b Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Project-Name: admin Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Role: member,reader,admin Jun 26 02:58:29.606962 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Roles: member,reader,admin Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/becb24f8723f432e9a3c4c740a191a0b"}]}] Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Tenant: admin Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Tenant-Id: becb24f8723f432e9a3c4c740a191a0b Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Tenant-Name: admin Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User: admin Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User-Domain-Id: default Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User-Domain-Name: Default Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User-Id: a05c37bdf694480a8a14de0b18b2da4b Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User-Name: admin Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: method: > Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: exception: Flavor 84 could not be found. Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: action_args: {'id': '84'} Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 02:58:29.608460 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 02:58:29.609328 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:29.610421 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-c23c2e32-d4c1-410a-bb8d-2e71a9063990 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 02:58:29.611405 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-c23c2e32-d4c1-410a-bb8d-2e71a9063990 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011554 Jun 26 02:58:29.611405 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Jun 26 02:58:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 26 02:58:30.419443 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-f5301e5a-9846-4ede-893c-c329d7b4ea77 admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:30.420450 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-f5301e5a-9846-4ede-893c-c329d7b4ea77 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 26 02:58:30.420846 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Jun 26 02:58:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:58:30.607947 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-7fb8314e-b40f-49d2-970f-ef93645fd312 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:30.613689 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.wsgi [None req-7fb8314e-b40f-49d2-970f-ef93645fd312 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-7fb8314e-b40f-49d2-970f-ef93645fd312 admin admin] Request method failure captured: Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Accept: application/json Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Accept-Encoding: gzip, deflate Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Connection: keep-alive Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Content-Length: 0 Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Host: 10.222.0.13 Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Openstack-Api-Version: compute 2.90 Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Openstack-System-Scope: None Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: User-Agent: python-novaclient Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Auth-Token: gAAAAABit8tWqr2sm0yWZH023v4Uh6cgspfNV9nWJLtGEdiv9XalGWR2FEYq4BmoBsFT1DTafSAxVNNT36ynkktrNw5xVeJQKilsvOB4N5wLTuyy_jXROxU3h_tGWR6slmS2qqhXPo2x9NJtUbxkwck0kurXv0anjZJZQ90mPiYlbPlleK5KMrE Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Domain-Id: None Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Domain-Name: None Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Identity-Status: Confirmed Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Is-Admin-Project: True Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Openstack-Nova-Api-Version: 2.90 Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Project-Domain-Id: default Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Project-Domain-Name: Default Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Project-Id: becb24f8723f432e9a3c4c740a191a0b Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Project-Name: admin Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Role: member,reader,admin Jun 26 02:58:30.615211 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Roles: member,reader,admin Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/becb24f8723f432e9a3c4c740a191a0b"}]}] Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Tenant: admin Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Tenant-Id: becb24f8723f432e9a3c4c740a191a0b Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-Tenant-Name: admin Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User: admin Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User-Domain-Id: default Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User-Domain-Name: Default Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User-Id: a05c37bdf694480a8a14de0b18b2da4b Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: X-User-Name: admin Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: method: > Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: exception: Flavor 451 could not be found. Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: action_args: {'id': '451'} Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 02:58:30.616727 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 02:58:30.617674 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Jun 26 02:58:30.619008 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-7fb8314e-b40f-49d2-970f-ef93645fd312 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 02:58:30.620317 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-7fb8314e-b40f-49d2-970f-ef93645fd312 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059806 Jun 26 02:58:30.620317 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Jun 26 02:58:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:30.626702 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-cf3ea292-030d-4c5a-babf-e32cea1c6eba admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:30.646066 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-cf3ea292-030d-4c5a-babf-e32cea1c6eba admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023417 Jun 26 02:58:30.646612 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Jun 26 02:58:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 02:58:30.656018 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:30.669635 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017167 Jun 26 02:58:30.670180 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Jun 26 02:58:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 02:58:30.678901 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-a983fb01-fb5d-47af-ac12-5e9ca8d75a3a admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:30.684189 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.wsgi [None req-a983fb01-fb5d-47af-ac12-5e9ca8d75a3a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-a983fb01-fb5d-47af-ac12-5e9ca8d75a3a admin admin] Request method failure captured: Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Accept: application/json Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Accept-Encoding: gzip, deflate Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Connection: keep-alive Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Content-Length: 0 Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Host: 10.222.0.13 Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Openstack-Api-Version: compute 2.90 Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Openstack-System-Scope: None Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: User-Agent: python-novaclient Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Auth-Token: gAAAAABit8tWqr2sm0yWZH023v4Uh6cgspfNV9nWJLtGEdiv9XalGWR2FEYq4BmoBsFT1DTafSAxVNNT36ynkktrNw5xVeJQKilsvOB4N5wLTuyy_jXROxU3h_tGWR6slmS2qqhXPo2x9NJtUbxkwck0kurXv0anjZJZQ90mPiYlbPlleK5KMrE Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Domain-Id: None Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Domain-Name: None Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Identity-Status: Confirmed Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Is-Admin-Project: True Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Openstack-Nova-Api-Version: 2.90 Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Project-Domain-Id: default Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Project-Domain-Name: Default Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Project-Id: becb24f8723f432e9a3c4c740a191a0b Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Project-Name: admin Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Role: member,reader,admin Jun 26 02:58:30.685668 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Roles: member,reader,admin Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/becb24f8723f432e9a3c4c740a191a0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/becb24f8723f432e9a3c4c740a191a0b"}]}] Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Tenant: admin Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Tenant-Id: becb24f8723f432e9a3c4c740a191a0b Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-Tenant-Name: admin Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User: admin Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User-Domain-Id: default Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User-Domain-Name: Default Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User-Id: a05c37bdf694480a8a14de0b18b2da4b Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: X-User-Name: admin Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: method: > Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: exception: Flavor 451 could not be found. Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: action_args: {'id': '451'} Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 02:58:30.687274 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 02:58:30.688190 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: ERROR nova.api.openstack.wsgi Jun 26 02:58:30.689513 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-a983fb01-fb5d-47af-ac12-5e9ca8d75a3a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 02:58:30.691351 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-a983fb01-fb5d-47af-ac12-5e9ca8d75a3a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011587 Jun 26 02:58:30.691351 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Jun 26 02:58:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:31.495970 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:31.496978 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 26 02:58:31.497374 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Jun 26 02:58:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:58:31.683163 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-8fc1e984-a63f-4640-8844-e45972b29576 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:58:31.700654 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-8fc1e984-a63f-4640-8844-e45972b29576 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067806 Jun 26 02:58:31.701194 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Jun 26 02:58:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 02:58:32.510518 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:32.511532 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 26 02:58:32.511929 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Jun 26 02:58:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:58:32.705944 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-0edbca85-7db8-422e-ab50-2fe96ff6187e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:58:32.723059 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-0edbca85-7db8-422e-ab50-2fe96ff6187e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068313 Jun 26 02:58:32.723549 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Jun 26 02:58:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 26 02:58:33.541676 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:33.542740 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 26 02:58:33.543175 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Jun 26 02:58:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:58:33.732201 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-50355681-1584-4e72-b092-64625af3186e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:58:33.748745 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-50355681-1584-4e72-b092-64625af3186e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067445 Jun 26 02:58:33.749568 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Jun 26 02:58:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 02:58:34.551263 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:34.552298 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 26 02:58:34.552726 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Jun 26 02:58:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:58:34.739396 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-e12284cb-1466-43b2-9d5b-0e09ea5c5810 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 02:58:34.756475 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-e12284cb-1466-43b2-9d5b-0e09ea5c5810 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067269 Jun 26 02:58:34.757007 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Jun 26 02:58:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 02:58:35.577210 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:35.578258 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 26 02:58:35.578658 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Jun 26 02:58:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:58:35.767573 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-2d72c6f8-aa0c-41eb-8c5c-39b8651d0700 admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:58:35.786688 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-2d72c6f8-aa0c-41eb-8c5c-39b8651d0700 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070687 Jun 26 02:58:35.787144 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Sun Jun 26 02:58:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 02:59:21.933477 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:59:21.934560 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-818c3e15-e81d-4688-b7a6-df23910f87de admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 26 02:59:21.935066 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 930 bytes} [Sun Jun 26 02:59:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 02:59:21.945996 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:59:21.993388 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-95b834e1-a0cd-43f7-8bcc-85ce3e19f881 admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:59:22.012966 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-95b834e1-a0cd-43f7-8bcc-85ce3e19f881 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071497 Jun 26 02:59:22.013548 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1291 bytes} [Sun Jun 26 02:59:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 02:59:22.035821 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-d1d85195-2422-4dc1-9080-9607a9499f93 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:59:22.039235 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG dbcounter [-] [103264] Writing DB stats nova_api:SELECT=14 {{(pid=103264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:59:22.044570 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-d1d85195-2422-4dc1-9080-9607a9499f93 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012335 Jun 26 02:59:22.045085 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1282 bytes} [Sun Jun 26 02:59:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 02:59:22.056660 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-86d8b053-ce1f-4249-8c40-db1e00f8393d admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:59:22.064205 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-86d8b053-ce1f-4249-8c40-db1e00f8393d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011101 Jun 26 02:59:22.064713 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1285 bytes} [Sun Jun 26 02:59:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 02:59:22.076084 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-b8915686-5ff9-43b2-b9c5-8aef91429e8d admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:59:22.083600 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-b8915686-5ff9-43b2-b9c5-8aef91429e8d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010977 Jun 26 02:59:22.084109 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1285 bytes} [Sun Jun 26 02:59:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 02:59:22.094556 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-f8187414-7031-4675-97f0-5885a0625136 admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 02:59:22.101852 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-f8187414-7031-4675-97f0-5885a0625136 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010620 Jun 26 02:59:22.102396 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1282 bytes} [Sun Jun 26 02:59:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:02:33.474665 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-b8915686-5ff9-43b2-b9c5-8aef91429e8d admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:02:33.475796 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-b8915686-5ff9-43b2-b9c5-8aef91429e8d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Jun 26 03:02:33.476265 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Jun 26 03:02:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:02:33.615478 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writing DB stats nova_api:SELECT=6 {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:02:33.729108 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-e41c0fed-2314-4a19-aadb-4967bc393f6a admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:02:33.730328 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:02:33.730328 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: warnings.warn(msg) Jun 26 03:02:33.731522 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-e41c0fed-2314-4a19-aadb-4967bc393f6a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:02:33.731957 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-e41c0fed-2314-4a19-aadb-4967bc393f6a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:02:33.732733 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-e41c0fed-2314-4a19-aadb-4967bc393f6a admin admin] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:02:33.733162 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-e41c0fed-2314-4a19-aadb-4967bc393f6a admin admin] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:02:33.770637 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-e41c0fed-2314-4a19-aadb-4967bc393f6a admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.156599 Jun 26 03:02:33.771194 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Jun 26 03:02:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 03:02:34.582343 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-b8915686-5ff9-43b2-b9c5-8aef91429e8d admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:02:34.583359 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-b8915686-5ff9-43b2-b9c5-8aef91429e8d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 26 03:02:34.583755 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Jun 26 03:02:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:02:34.787907 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-7594bc65-f4ab-41e8-a28e-ab6964fa11d5 admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:02:34.789070 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:02:34.789070 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: warnings.warn(msg) Jun 26 03:02:34.790327 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-7594bc65-f4ab-41e8-a28e-ab6964fa11d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:02:34.790769 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-7594bc65-f4ab-41e8-a28e-ab6964fa11d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:02:34.791555 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-7594bc65-f4ab-41e8-a28e-ab6964fa11d5 admin admin] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:02:34.792036 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-7594bc65-f4ab-41e8-a28e-ab6964fa11d5 admin admin] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:02:34.811022 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-7594bc65-f4ab-41e8-a28e-ab6964fa11d5 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074718 Jun 26 03:02:34.811555 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Jun 26 03:02:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 03:02:46.046357 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-b8915686-5ff9-43b2-b9c5-8aef91429e8d admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:02:46.047351 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-b8915686-5ff9-43b2-b9c5-8aef91429e8d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 26 03:02:46.047741 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Jun 26 03:02:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:02:46.190010 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writing DB stats nova_cell0:SELECT=4 {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:02:46.190751 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writing DB stats nova_cell1:SELECT=4 {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:02:46.191356 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG dbcounter [-] [103263] Writing DB stats nova_api:SELECT=8 {{(pid=103263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:02:46.240047 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-23aadb09-5ace-4e5f-aae0-0af18ec7187c admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:02:46.241207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:02:46.241207 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: warnings.warn(msg) Jun 26 03:02:46.242424 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-23aadb09-5ace-4e5f-aae0-0af18ec7187c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:02:46.242861 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-23aadb09-5ace-4e5f-aae0-0af18ec7187c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:02:46.243693 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-23aadb09-5ace-4e5f-aae0-0af18ec7187c admin admin] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:02:46.244119 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-23aadb09-5ace-4e5f-aae0-0af18ec7187c admin admin] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:02:46.269604 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-23aadb09-5ace-4e5f-aae0-0af18ec7187c admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084544 Jun 26 03:02:46.270167 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Jun 26 03:02:46 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:02:47.102880 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-b8915686-5ff9-43b2-b9c5-8aef91429e8d admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:02:47.103829 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-b8915686-5ff9-43b2-b9c5-8aef91429e8d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 26 03:02:47.104232 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Jun 26 03:02:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:02:47.293554 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG nova.api.openstack.wsgi [None req-0a18d718-3859-407c-a870-103a2ffa3089 admin admin] Calling method '>' {{(pid=103263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:02:47.294757 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:02:47.294757 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: warnings.warn(msg) Jun 26 03:02:47.295945 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-0a18d718-3859-407c-a870-103a2ffa3089 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:02:47.296380 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-0a18d718-3859-407c-a870-103a2ffa3089 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:02:47.297159 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-0a18d718-3859-407c-a870-103a2ffa3089 admin admin] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:02:47.297670 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: DEBUG oslo_concurrency.lockutils [None req-0a18d718-3859-407c-a870-103a2ffa3089 admin admin] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:02:47.319423 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: INFO nova.api.openstack.requestlog [None req-0a18d718-3859-407c-a870-103a2ffa3089 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077393 Jun 26 03:02:47.319954 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: [pid: 103263|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Jun 26 03:02:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:03:43.995891 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: Sun Jun 26 03:03:43 2022 - graceful shutdown triggered... Jun 26 03:03:43.995994 dv-cinder-846842-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 26 03:03:43.996937 dv-cinder-846842-4-iscsi devstack@n-api.service[103263]: Gracefully killing worker 1 (pid: 103263)... Jun 26 03:03:43.997362 dv-cinder-846842-4-iscsi devstack@n-api.service[103264]: Gracefully killing worker 2 (pid: 103264)... Jun 26 03:03:44.998036 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: worker 1 buried after 1 seconds Jun 26 03:03:44.998549 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: worker 2 buried after 1 seconds Jun 26 03:03:44.998549 dv-cinder-846842-4-iscsi devstack@n-api.service[103262]: goodbye to uWSGI. Jun 26 03:03:44.999651 dv-cinder-846842-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 26 03:03:45.000182 dv-cinder-846842-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 26 03:03:45.003213 dv-cinder-846842-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 26 03:03:45.012315 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 26 03:03:45.014358 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jun 26 03:03:45 2022] *** Jun 26 03:03:45.014358 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 26 03:03:45.014358 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 26 03:03:45.014358 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: nodename: dv-cinder-846842-4-iscsi Jun 26 03:03:45.014358 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: machine: x86_64 Jun 26 03:03:45.014358 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: clock source: unix Jun 26 03:03:45.014358 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: pcre jit disabled Jun 26 03:03:45.014358 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: detected number of CPU cores: 4 Jun 26 03:03:45.014358 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: current working directory: / Jun 26 03:03:45.014358 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: detected binary path: /usr/bin/uwsgi-core Jun 26 03:03:45.014358 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: your processes number limit is 47680 Jun 26 03:03:45.015068 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: your memory page size is 4096 bytes Jun 26 03:03:45.015068 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: detected max file descriptor number: 2048 Jun 26 03:03:45.015068 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: lock engine: pthread robust mutexes Jun 26 03:03:45.015068 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: thunder lock: enabled Jun 26 03:03:45.015068 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 26 03:03:45.015068 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 26 03:03:45.060224 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: Python main interpreter initialized at 0x564d1d2fa9c0 Jun 26 03:03:45.060224 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: python threads support enabled Jun 26 03:03:45.060224 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: your server socket listen backlog is limited to 100 connections Jun 26 03:03:45.060224 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: your mercy for graceful operations on workers is 90 seconds Jun 26 03:03:45.060581 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: mapped 403077 bytes (393 KB) for 2 cores Jun 26 03:03:45.060581 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: *** Operational MODE: preforking *** Jun 26 03:03:45.060875 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: *** uWSGI is running in multiple interpreter mode *** Jun 26 03:03:45.060875 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: spawned uWSGI master process (pid: 117763) Jun 26 03:03:45.061075 dv-cinder-846842-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 26 03:03:45.063588 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: spawned uWSGI worker 1 (pid: 117782, cores: 1) Jun 26 03:03:45.063697 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: spawned uWSGI worker 2 (pid: 117783, cores: 1) Jun 26 03:03:45.063776 dv-cinder-846842-4-iscsi devstack@n-api.service[117763]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 26 03:03:45.719507 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 26 03:03:45.720582 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 26 03:03:46.928570 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 26 03:03:46.928570 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: from cryptography.utils import int_from_bytes Jun 26 03:03:46.929271 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 26 03:03:46.929271 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: from cryptography.utils import int_from_bytes Jun 26 03:03:46.931265 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 26 03:03:46.931265 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: from cryptography.utils import int_from_bytes Jun 26 03:03:46.931700 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 26 03:03:46.931700 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: from cryptography.utils import int_from_bytes Jun 26 03:03:49.318505 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 26 03:03:49.319222 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 26 03:03:49.319333 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 26 03:03:49.319663 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 26 03:03:49.319923 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 26 03:03:49.320314 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.320644 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.320969 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.321291 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.321628 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.321942 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.322292 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.322615 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.322947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.323211 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.323529 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.323860 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-4-iscsi {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.324181 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.324493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.324806 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.325125 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.325430 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.325824 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.326176 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.326846 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.327473 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.327792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.328112 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.328990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.329312 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.329630 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.329950 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.330282 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.330613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.330940 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.331344 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-4-iscsi {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.331660 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.331980 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.332288 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.332703 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.333023 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.333340 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.333664 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.334034 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.334380 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.334760 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.335099 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.335466 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.335803 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.336109 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.336420 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.336733 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.337052 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.337236 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 26 03:03:49.337666 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.337758 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 26 03:03:49.337844 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.338014 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 26 03:03:49.338151 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.338396 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 26 03:03:49.338497 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.338672 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 26 03:03:49.338827 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.339037 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.339364 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.339804 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.339900 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.339993 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.340192 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.340299 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.340486 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.340593 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.340810 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.340907 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.341134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.341236 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.341446 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.341540 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.341758 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.341854 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.342016 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.342137 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.342351 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.342492 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.342804 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.342976 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-4-iscsi {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.343103 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.343306 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.343407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.343635 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.343744 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.343974 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.344680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.344844 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.345079 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.345317 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.345435 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.345691 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.345856 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.346064 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.346214 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.346455 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.346617 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.346805 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.346999 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.347116 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.347269 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.347452 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.347597 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.347766 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.347925 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.348073 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.348249 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.348391 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.348564 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.348701 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.348890 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.348992 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.349216 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.349309 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.349531 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.349690 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-4-iscsi {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.349830 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.349995 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.350174 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.350357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.350502 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.350671 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.350850 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.351079 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.351180 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.351390 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.351490 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.351696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.351786 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.352010 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.352111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.352333 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.352441 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.352649 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.352764 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.352957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.353058 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.353269 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.353435 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.353576 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.353718 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.353873 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.353965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.354251 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.354397 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.354520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.354629 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.354824 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.354923 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.355135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.355240 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.355438 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.355560 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.355739 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.355839 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.355988 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.356079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.356293 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.356387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.356611 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.356702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.356928 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.357028 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.357244 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.357351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.357495 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.357599 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.357734 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.357839 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.358085 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.358183 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.358413 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.358652 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.358753 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.358970 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.359070 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.359290 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.359430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.359632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.359741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.359937 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.360047 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.360243 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.360358 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.360547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.360654 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.360850 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.360955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.361160 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.361267 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.361468 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.361574 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.361774 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.361878 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.362096 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.362209 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.362417 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.362524 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.362728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.362827 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.363038 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.363144 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.363344 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.363472 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.363650 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.363759 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.363955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.364057 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.364262 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.364369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.364567 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.364659 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.364873 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.364966 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.365173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.365277 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.365495 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.365612 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.365807 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.365912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.366138 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.366255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.366449 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.366556 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.366754 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.366846 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.367005 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.367095 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.367309 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.367410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.367618 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.367720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.367935 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.368036 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.368242 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.368345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.368577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.368738 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.368854 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.369143 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.369265 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.369443 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.369543 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.369757 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.369859 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.370083 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.370210 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.370390 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.370493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.370698 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.370801 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.371004 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.371122 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.371311 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.371410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.371616 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.371714 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.371920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.372033 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.372238 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.372338 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.372558 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.372664 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.372864 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.372989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.373186 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.373307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.373497 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.373602 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.373821 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.373928 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.374473 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.374631 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.374756 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.374880 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.374999 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.375118 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.375230 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.375354 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.375484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.375811 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.375951 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.376053 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.376138 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.376231 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.376443 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.376537 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.376812 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.376924 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.377130 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.377237 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.377686 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.377786 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.377997 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.378125 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.378338 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.378431 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.378646 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.378738 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.378951 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.379050 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.379257 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.379349 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.379566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.379657 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.379869 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.379968 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.380173 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.380279 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.380474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.380574 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.380776 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.380879 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.381075 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.381176 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.381391 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.381491 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.381709 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.381800 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.382016 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.382210 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.382346 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.382439 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.382650 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.382741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.382960 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.383063 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 03:03:49.383274 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.383408 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.383582 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.383689 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.383890 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.384002 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.384217 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.384332 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.384512 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.384621 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.384832 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.384926 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.385160 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.385259 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.385468 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.385569 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.385782 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.385875 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.386114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.386222 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.386429 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.386528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.386740 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.386832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.387046 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.387144 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.387353 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.387453 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.387671 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.387771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.387979 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.388075 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.388288 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.388393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.388603 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.388702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.388915 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.389006 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.389224 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.389327 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.389548 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.389640 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.389857 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.389954 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.390191 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.390307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.390501 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.390591 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.391321 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.391428 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.391642 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.391935 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.392036 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.392250 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.392350 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.392572 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.392671 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.392891 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.392992 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.393202 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.393294 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.393513 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.393614 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.393822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.393940 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.394164 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.394274 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.394495 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.394614 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.394804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.394903 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.395121 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.395214 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.395426 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.395517 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.395734 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.395823 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.396043 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.396206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.396352 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.396521 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.396665 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.396883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.396988 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.397197 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.397314 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.397505 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.397815 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.398183 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.398305 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.398469 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.398694 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.398778 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.399065 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.399154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.399383 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.399478 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.399692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.399781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.400002 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.400089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.400311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.400403 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.400654 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.400737 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.401517 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.401517 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.401708 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.401797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.401869 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.401947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.402164 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.402265 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.402507 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.402616 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.402856 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.402961 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.403173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.403269 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.403494 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.403602 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.403812 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.403919 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.404127 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.404283 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.404443 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.404760 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.404918 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.405082 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.405324 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.405419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.405658 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.405754 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.406010 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.406130 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.406360 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.406510 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.407211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.407363 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.407527 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.407690 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.407864 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.408028 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.408182 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.408329 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.408512 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.408674 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.408830 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.408997 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.409145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.409300 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.409446 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.409592 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.409740 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.409899 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.410072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.410238 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.410395 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.410543 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.410699 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.410863 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.411040 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.411192 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.411347 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.411494 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.411674 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.411825 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.411973 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.412127 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.412283 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.412506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.412678 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.412836 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.412984 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.413150 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.413306 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.413453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.413661 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.413836 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.414077 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.414246 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.414394 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.414550 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.414708 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.415475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.415647 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.415804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.415974 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.416124 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.416281 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.416281 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.416681 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.416838 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.416986 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.417144 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.417291 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.417438 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.417584 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.417738 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.417905 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.418124 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.418283 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.418431 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.418577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.418734 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.418882 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.419044 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.419194 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.419340 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.419487 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.419634 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.419788 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.419961 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.420117 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.420273 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.420429 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.420577 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.420737 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.420885 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.421041 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.421197 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.421352 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.421507 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.421667 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.421822 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.421822 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.422161 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.422330 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.422480 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.422730 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.422887 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.423035 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.423182 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.423337 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.423493 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.423649 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.423797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.423951 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.424194 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.424358 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.424517 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.424672 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.424820 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.424966 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.425120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.425268 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.425445 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.425672 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.425672 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.425974 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.426156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.426317 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.426480 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.427163 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.427334 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.427485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.427641 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.427788 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.427944 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.427944 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.428239 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.428387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.428543 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.428711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.428868 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.429022 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.429176 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.429324 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.429470 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.429627 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.429775 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.429929 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.430111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.430281 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.430430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.430591 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.430758 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.430914 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.431080 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.431229 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.431376 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.431533 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.431682 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.431682 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.431971 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.432117 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.432264 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.432264 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.432559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.432747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.432981 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.433146 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.433304 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.433304 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.433585 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.433740 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.433889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.434068 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.434317 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.434317 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.434620 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.434780 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.434938 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.435092 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.435247 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.435394 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.435540 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.435717 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.435934 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.436087 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.436235 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.436381 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.436381 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.436674 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.436840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.436989 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.437161 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.437395 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.437564 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.437751 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.437903 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.437903 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.438235 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.438394 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.438542 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.438703 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.438852 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.439020 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.439177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.439326 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.439482 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.439629 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.439783 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.439937 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.440092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.440239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.440395 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.440560 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.440758 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.440915 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.441085 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.441235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.441396 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.441552 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.441706 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.441861 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.442010 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.442206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.442357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.442505 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.442653 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.442800 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.442964 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.443205 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.443368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.443517 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.443671 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.443819 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.443966 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.444127 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.444303 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.444531 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.444685 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.444841 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.444989 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.445156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.445156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.445438 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.445604 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.445760 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.445935 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.446214 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.446372 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.446518 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.446666 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.446666 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.446959 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.447107 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.447272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.447444 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.447678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.447830 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.448063 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.448222 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.448369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.448518 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.448518 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.448806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.448966 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.449115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.449271 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.449437 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.449586 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.449742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.449889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.450058 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.450225 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.450381 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.450537 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.450698 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.450854 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.450854 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.451153 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.451301 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.451458 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.451620 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.451777 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.451932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.452079 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.452233 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.452388 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.452544 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.452544 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.452833 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.452981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.453134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.453896 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.454094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.454262 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.454412 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.454653 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.454653 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.454961 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.455112 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.455266 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.455414 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.455562 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.455709 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.455709 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.456095 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.456334 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.456499 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.456654 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.456654 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.457282 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.457449 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.457598 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.457865 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.458031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.458217 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.458367 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.458514 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.458514 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.458514 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.458951 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.459098 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.459253 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.459424 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.459580 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.459736 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.459885 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.460033 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.460187 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.460335 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.460492 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.460651 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.460806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.460955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.461103 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.461258 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.461419 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.461586 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.461742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.461898 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.462083 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.462241 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.462406 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.462566 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.462714 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.462862 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.463009 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.463165 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.463322 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.463478 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.463632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.463780 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.464017 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.464190 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.464513 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.464691 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.464922 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.465084 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.465242 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.465400 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.465400 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.465690 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.465839 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.465994 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.466178 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.466361 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.466578 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.466731 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.466887 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.467046 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.467202 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.467202 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.467501 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.467663 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.467819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.468070 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.468240 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.468397 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.468554 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.468702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.468857 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.469078 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.469757 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.469907 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.470108 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.470265 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.470425 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.470583 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.470745 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.470939 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.471103 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.471259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.471259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.471553 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.471729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.471886 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.472041 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.472199 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.472348 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.472504 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.472661 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.472816 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.472965 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.473120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.473275 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.473435 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.473598 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.473765 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.473920 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.474174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.474342 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.474500 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.474649 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.474805 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.475038 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.475194 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.475342 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.475499 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.475648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.475796 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.475954 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.476115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.476276 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.476425 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.476590 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.476817 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.476972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.477126 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.477284 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.477431 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.477586 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.477741 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.477899 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.477899 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.478341 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.478497 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.478653 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.478808 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.478957 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.479119 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.479278 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.479425 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.479580 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.479729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.479882 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.480039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.480212 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.480362 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.480509 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.480656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.480803 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.480959 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.480959 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.481242 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.481389 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.481389 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.481697 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.481854 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.482023 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.482023 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.482341 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.482490 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.482645 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.482801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.482949 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.483105 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.483262 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.483411 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.483567 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.483722 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.483870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.484033 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.484209 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.484434 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.484699 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.484865 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.485040 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.485267 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.485421 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.485578 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.485808 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.485958 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.486167 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.486322 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.486489 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.486638 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.486817 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.487041 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.487205 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.487361 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.487517 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.487517 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.487814 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.487962 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.487962 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.488252 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.488518 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.488683 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.488834 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.488982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.488982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.489272 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.489428 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.489587 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.489736 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.489897 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.490086 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.490255 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.490406 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.490579 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.490728 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.490883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.491038 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.491185 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.491185 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.491482 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.491635 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.491782 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.491929 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.492082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.492238 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.492387 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.492547 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.492694 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.492849 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.492997 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.493157 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.493306 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.493467 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.493616 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.493764 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.493911 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.494101 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.494269 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.494436 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.494678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.494832 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.494979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.495142 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.495307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.495538 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.495693 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.495842 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.496004 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.496160 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.496308 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.496463 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.496463 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.496756 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.496913 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.497079 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.497306 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.497466 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.497615 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.497764 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.497930 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.498097 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.498252 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.498252 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.498577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.498836 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.498991 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.499147 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.499304 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.499453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.499610 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.499759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.499908 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.500055 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.500234 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.500386 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.500543 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.500693 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.500860 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.501009 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.501165 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.501328 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.501328 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.501637 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.501794 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.501950 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.502176 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.502343 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.502751 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.502998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.503162 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.503329 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.503485 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.503643 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.503800 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.503949 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.504098 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.504245 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.504393 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.504393 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.504711 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.504947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.505102 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.505280 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.505444 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.505688 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.505843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.505992 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.506174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.506325 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.506486 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.506643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.506800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.506955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.506955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.507254 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.507514 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.507676 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.507826 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.507981 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.508130 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.508287 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.508515 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.508674 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.508823 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.508995 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.509239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.509409 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.509566 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.509730 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.509878 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.509878 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.510195 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.510356 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.510505 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.510660 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.510808 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.510963 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.511129 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.511321 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.511487 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.511639 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.511639 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.511940 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.512087 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.512243 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.512398 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.512548 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.512696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.512851 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.512851 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.513149 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.513296 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.513443 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.513608 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.513766 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.513945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.514158 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.514313 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.514472 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.514623 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.514778 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.514953 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.515191 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.515352 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.515501 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.515667 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.516421 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.516421 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.516725 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.516881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.517030 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.517186 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.517344 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.517511 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.517736 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.517890 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.518069 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.518255 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.518437 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.518587 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.518587 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.518886 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.519043 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.519200 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.519475 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.519639 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.519797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.519950 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.520105 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.520272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.520438 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.520587 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.520743 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.520901 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.521057 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.521219 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.521367 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.521514 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.521662 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.521816 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.521971 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.521971 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.522321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.522496 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.522646 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.522801 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.522960 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.523116 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.523273 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.523420 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.523577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.523734 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.523892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.524042 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.524189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.524353 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.524503 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.524658 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.524815 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.524963 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.525119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.525358 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.525521 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.525679 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.525828 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.525828 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.526131 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.526293 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.526540 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.526706 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.526856 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.527004 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.527160 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.527316 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.527466 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.527622 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.527853 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.528008 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.528165 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.528314 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.528462 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.528462 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.528779 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.528936 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.528936 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.529220 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.529382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.529629 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.529785 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.529934 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.530155 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.530320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.530478 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.530648 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.530797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.530945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.531092 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.531238 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.531422 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.532177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.532177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.532480 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.532630 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.532777 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.532777 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.533080 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.533242 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.533391 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.533547 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.533710 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.533859 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.534013 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.534195 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.534346 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.534346 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.534650 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.534650 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.534933 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.535089 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.535248 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.535492 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.535671 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.535831 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.535979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.536133 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.536281 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.536437 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.536680 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.536845 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.536994 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.537150 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.537298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.537466 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.537617 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.537773 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.538011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.538208 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.538357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.538522 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.538681 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.538837 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.538837 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.538837 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.539265 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.539496 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.539664 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.539901 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.540061 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.540210 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.540364 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.540525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.540675 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.540831 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.540987 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.541143 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.541303 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.541452 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.541617 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.541774 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.541924 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.542109 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.542218 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.542310 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.542310 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.542310 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.542527 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.542610 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.542705 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.542789 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.542877 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.542961 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.543042 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.543126 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.543126 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.543126 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.543126 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.543386 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.543553 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.543798 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.543903 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.544169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.544251 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.544511 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.544759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.544854 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.545101 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.545194 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.545426 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.545524 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.545770 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.545876 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.546232 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.546353 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.546475 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.546585 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.546785 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.547056 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.547184 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.547392 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.547533 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.547711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.547872 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.548014 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.548208 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.548324 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.548552 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.548670 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.548906 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.549033 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.549236 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.549360 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.549551 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.549677 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.549864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.550114 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.550254 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.550365 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.550504 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.550712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.550840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.551045 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.551163 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.551367 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.551493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.551698 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.551816 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.552028 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.552153 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.552357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.552489 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.552677 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.552800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.552997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.553121 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.553320 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.553445 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.553635 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.553752 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.553949 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.554096 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.554289 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.554440 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.554604 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.554779 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.554926 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.555139 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.555277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.555459 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.555585 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.555809 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.555945 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.556141 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.556366 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.556485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.556684 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.556885 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.557010 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.557318 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.557651 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.557907 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.558025 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.558287 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.558481 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.558615 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.558816 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.558941 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.559167 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.559291 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.559512 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.559640 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.559854 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.559979 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.560200 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.560323 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.560507 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.560634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.560816 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.560942 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.561123 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.561269 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.561430 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.561593 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.561741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.561919 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.562113 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.562268 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.562409 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.562588 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.563226 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.563476 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.563621 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.563841 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.563975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.564162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.564294 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.564496 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.564621 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.564822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.564949 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.565128 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.565369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.565489 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.565730 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.565864 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.566103 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.566244 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.566380 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.566507 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.566633 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.566764 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.567002 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.567238 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.567362 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.567549 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.567665 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.567889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.568008 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.568150 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.568275 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.568470 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.568594 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.568747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.568865 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.569050 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.569175 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.569413 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.569539 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.569730 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.569851 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.570025 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.570174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.570393 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.570537 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.570683 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.570808 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.571008 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.571132 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.571322 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.571449 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.571648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.571765 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.571972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.572089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.572295 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.572422 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.572609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.572726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.572941 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.573057 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.573254 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.573383 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.573571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.573688 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.573885 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.574001 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.574228 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.574366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.574542 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.574659 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.574858 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.574983 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.575190 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.575333 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.575516 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.575636 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.575815 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.575940 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.576151 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.576284 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.576448 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.576565 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.576770 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.576895 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.577111 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.577401 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.577524 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.577733 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.577850 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.578109 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.578286 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.579055 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.579173 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.579288 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.579398 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.579526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.579638 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.579825 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.580061 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.580178 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.580538 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.580674 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.580786 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.580902 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.581100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.581217 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.581414 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.581705 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.581832 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.582203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.582370 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.582519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.582685 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.582845 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.582999 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.583155 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.583312 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.583461 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.583622 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.583783 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.583931 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.584086 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.584234 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.584390 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.584545 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.584694 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 26 03:03:49.584843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.585078 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.585405 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.585730 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.586069 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.586395 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.586713 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.587032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.587502 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.587824 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.588147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.588466 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.589254 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.589254 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.589575 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.589756 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.590104 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.590461 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.590789 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.591109 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.591427 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.591747 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.592065 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.592392 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.592730 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.593052 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.593367 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.593912 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.594272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.594604 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.594932 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.595252 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.595582 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.595915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.596234 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.596565 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.596881 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.597939 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.597939 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.598386 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.598386 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.598701 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.598947 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.599514 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.599844 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.600176 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.600499 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.600858 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.601121 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.601444 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.601760 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.602597 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.602597 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.602911 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.603305 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.603620 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.603993 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.604240 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.604567 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.604865 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.605175 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.605490 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.605875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.606151 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.606468 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.606780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.607092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.607467 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.607806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.608120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.608450 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.608766 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.609096 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.609415 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.609780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.610133 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.610475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.610791 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.611160 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.611475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.611797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.612120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.612438 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.612756 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.613076 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.613414 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.613776 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.614525 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.614678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.615010 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.615340 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.615666 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.615996 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.616332 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.616745 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.617066 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.617392 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.617711 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.618031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.618382 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.618706 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.619043 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.619379 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.619707 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.620055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.620389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.620744 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.621067 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.621419 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.621751 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.622094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.622516 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.622731 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 03:03:49.622982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 26 03:03:49.648070 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO dbcounter [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] Registered counter for database nova_api Jun 26 03:03:49.668353 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_db.sqlalchemy.engines [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 03:03:49.674981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writer thread running {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 03:03:49.687523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO dbcounter [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] Registered counter for database nova_api Jun 26 03:03:49.708863 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_db.sqlalchemy.engines [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 03:03:49.715569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writer thread running {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 03:03:49.731330 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.context [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),025aa3fa-78c7-46e8-960a-ec1720423979(cell1) {{(pid=117782) load_cells /opt/stack/nova/nova/context.py:464}} Jun 26 03:03:49.735426 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:03:49.737028 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:03:49.737838 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:03:49.739844 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:03:49.741837 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO dbcounter [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] Registered counter for database nova_cell0 Jun 26 03:03:49.745816 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO dbcounter [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] Registered counter for database nova_cell1 Jun 26 03:03:49.754030 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_db.sqlalchemy.engines [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 03:03:49.756231 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_db.sqlalchemy.engines [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 03:03:49.761776 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writer thread running {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 03:03:49.763910 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writer thread running {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 03:03:49.773478 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.context [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),025aa3fa-78c7-46e8-960a-ec1720423979(cell1) {{(pid=117783) load_cells /opt/stack/nova/nova/context.py:464}} Jun 26 03:03:49.777630 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:03:49.779298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:03:49.780120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:03:49.782173 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:03:49.784191 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO dbcounter [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] Registered counter for database nova_cell0 Jun 26 03:03:49.788231 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO dbcounter [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] Registered counter for database nova_cell1 Jun 26 03:03:49.795977 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_db.sqlalchemy.engines [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 03:03:49.798200 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_db.sqlalchemy.engines [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 03:03:49.802767 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writer thread running {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 03:03:49.808710 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writer thread running {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 03:03:49.912485 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO dbcounter [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] Registered counter for database nova_cell0 Jun 26 03:03:49.919052 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_db.sqlalchemy.engines [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 03:03:49.923995 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writer thread running {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 03:03:49.958729 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO dbcounter [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] Registered counter for database nova_cell0 Jun 26 03:03:49.967278 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_db.sqlalchemy.engines [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 03:03:49.971700 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writer thread running {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 03:03:50.244959 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: WARNING keystonemiddleware.auth_token [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 26 03:03:50.253580 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: WARNING keystonemiddleware.auth_token [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 26 03:03:50.294398 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: WARNING keystonemiddleware.auth_token [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 26 03:03:50.302440 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: WARNING keystonemiddleware.auth_token [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 26 03:03:50.595971 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: WARNING keystonemiddleware.auth_token [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 26 03:03:50.602118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: WARNING keystonemiddleware.auth_token [None req-38970adb-b3e1-410d-8d14-1e421e841480 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 26 03:03:50.607577 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564d1d2fa9c0 pid: 117782 (default app) Jun 26 03:03:50.648318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: WARNING keystonemiddleware.auth_token [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 26 03:03:50.655558 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: WARNING keystonemiddleware.auth_token [None req-3b4a5353-3eef-4775-b5fb-33b46a469924 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 26 03:03:50.661556 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564d1d2fa9c0 pid: 117783 (default app) Jun 26 03:04:34.600377 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=3 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:34.601364 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=3 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:34.602250 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=3 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:34.603107 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=3 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:35.164636 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-0e656e9d-8075-4856-ba9c-b549de8cc64d tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] Calling method '.version_select at 0x7f582d6f6280>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:35.652083 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-0e656e9d-8075-4856-ba9c-b549de8cc64d tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e41b079e-a5b1-43c2-b678-12382b1167d0" status: 200 len: 351 microversion: 2.1 time: 1.059541 Jun 26 03:04:35.653332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 1/1] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:04:34 2022] GET /compute/v2.1/os-volumes/e41b079e-a5b1-43c2-b678-12382b1167d0 => generated 351 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:04:37.504693 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:37.505927 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:37.508105 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:37.509885 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:37.884849 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d940640e-0919-4a48-8d93-a7bb5b55e187 tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] Calling method '.version_select at 0x7f582d6f51f0>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:38.462030 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d940640e-0919-4a48-8d93-a7bb5b55e187 tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/991bbe6a-7d2b-4dba-941e-3dd2c43c7785" status: 200 len: 351 microversion: 2.1 time: 0.963525 Jun 26 03:04:38.463513 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 1/2] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:04:37 2022] GET /compute/v2.1/os-volumes/991bbe6a-7d2b-4dba-941e-3dd2c43c7785 => generated 351 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:04:42.519315 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-64bb7104-314c-4cd3-aa9e-15274a045f26 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Action: 'create', calling method: .version_select at 0x7f582d5ba4c0>, body: {"keypair": {"name": "tempest-keypair-389962117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6/o5Udl2vz/IBz5w0+TCfnzjIELcN9MTfjx+eBWNcuQ+I8a9/3a+/IlD+MruwxE58R9lnawGNLBO8PWhpe70gox/MY91Sg8wO9uEB4JSDGHP46qQYcxfLCS6jchLpPFw=="}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:04:42.606599 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-64bb7104-314c-4cd3-aa9e-15274a045f26 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Getting quotas for project 5dd1a7a651fa4d27a1b6488ca13effca. Resources: {'key_pairs'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:04:42.624800 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-64bb7104-314c-4cd3-aa9e-15274a045f26 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Getting quotas for user 430d2efc691e4aae9f96409b081c7e96 and project 5dd1a7a651fa4d27a1b6488ca13effca. Resources: {'key_pairs'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:04:42.739194 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-64bb7104-314c-4cd3-aa9e-15274a045f26 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.453820 Jun 26 03:04:42.740130 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 2/3] 10.222.0.13 () {62 vars in 1199 bytes} [Sun Jun 26 03:04:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 455 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 26 03:04:44.801378 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d8375832-5637-4a11-b73f-90f843360f70 tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] Calling method '.version_select at 0x7f582d5bc550>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:44.940597 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d8375832-5637-4a11-b73f-90f843360f70 tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d36126b2-bc61-4186-ba12-850083a7560b" status: 200 len: 351 microversion: 2.1 time: 0.145156 Jun 26 03:04:44.948245 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:04:44 2022] GET /compute/v2.1/os-volumes/d36126b2-bc61-4186-ba12-850083a7560b => generated 351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:04:44.955444 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e3144b51-73d6-461e-84ed-d95cc0a5b809 tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] Calling method '.version_select at 0x7f582d4d9310>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:45.201626 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e3144b51-73d6-461e-84ed-d95cc0a5b809 tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.251361 Jun 26 03:04:45.202104 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 3/5] 10.222.0.13 () {58 vars in 1133 bytes} [Sun Jun 26 03:04:44 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:04:45.215017 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0c07bbc7-d791-4d6d-9997-a62976604e2f tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] Calling method '.version_select at 0x7f582d5bcc10>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:45.503604 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0c07bbc7-d791-4d6d-9997-a62976604e2f tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.292227 Jun 26 03:04:45.504181 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 3/6] 10.222.0.13 () {58 vars in 1148 bytes} [Sun Jun 26 03:04:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:04:45.516892 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8e6d990a-c85a-4e98-9c7f-8dc832db4949 tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] Calling method '.version_select at 0x7f582d507550>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:45.760517 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8e6d990a-c85a-4e98-9c7f-8dc832db4949 tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.245521 Jun 26 03:04:45.761454 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1133 bytes} [Sun Jun 26 03:04:45 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:04:45.776977 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0e4b0268-5110-4680-aeda-4206a25a9726 tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] Calling method '.version_select at 0x7f582d5bcd30>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:45.904838 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0e4b0268-5110-4680-aeda-4206a25a9726 tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.134497 Jun 26 03:04:45.910506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1166 bytes} [Sun Jun 26 03:04:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:04:45.921925 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-aeb8334a-f260-4cb2-9556-eddc5ee05c26 tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] Calling method '.version_select at 0x7f582d4d9c10>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:46.159530 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-aeb8334a-f260-4cb2-9556-eddc5ee05c26 tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.241524 Jun 26 03:04:46.161244 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 5/9] 10.222.0.13 () {58 vars in 1169 bytes} [Sun Jun 26 03:04:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:04:46.174549 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ae592377-b9eb-4d02-b69e-b411eec13c9e tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] Calling method '.version_select at 0x7f582d581160>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:46.419905 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ae592377-b9eb-4d02-b69e-b411eec13c9e tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.250430 Jun 26 03:04:46.420765 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 5/10] 10.222.0.13 () {58 vars in 1154 bytes} [Sun Jun 26 03:04:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:04:46.433797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-76bac679-e3d7-4780-921a-becd36eb187b tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] Calling method '.version_select at 0x7f582d581dc0>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:46.638403 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-76bac679-e3d7-4780-921a-becd36eb187b tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.210030 Jun 26 03:04:46.640663 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 6/11] 10.222.0.13 () {58 vars in 1187 bytes} [Sun Jun 26 03:04:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:04:46.653315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-58c48408-4648-45f7-90b8-1c77fec9afed tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] Calling method '.version_select at 0x7f582d5813a0>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:46.701509 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-302c1500-dff7-46f5-8486-8cdda974f037 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Action: 'create', calling method: .version_select at 0x7f582d5074c0>, body: {"keypair": {"name": "tempest-keypair-1875808098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzMYONt5QfcfSr1AcQMVHypGE92JZzxyij7BX23hDRjsQLP3yG9FRsvP+Cst/zOCO08MY9kFtiVoSfSKucHE4An/E479jywMPOLpucvdSy8wo8Hmgy02M00LrMPHn0U/w=="}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:04:46.752364 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-302c1500-dff7-46f5-8486-8cdda974f037 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Getting quotas for project ea86edd65ecb4972ba8bb33b34387432. Resources: {'key_pairs'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:04:46.766211 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-302c1500-dff7-46f5-8486-8cdda974f037 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Getting quotas for user 95793ccb15844069890363d983f1680d and project ea86edd65ecb4972ba8bb33b34387432. Resources: {'key_pairs'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:04:46.833248 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-302c1500-dff7-46f5-8486-8cdda974f037 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.417881 Jun 26 03:04:46.839819 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 6/12] 10.222.0.13 () {60 vars in 1158 bytes} [Sun Jun 26 03:04:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:04:46.867343 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-58c48408-4648-45f7-90b8-1c77fec9afed tempest-VolumesTestJSON-617570680 tempest-VolumesTestJSON-617570680-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.219046 Jun 26 03:04:46.871637 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1154 bytes} [Sun Jun 26 03:04:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:04:50.402420 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-268434401", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "networks": [{"uuid": "26d75899-1607-4d4e-b529-22178d34e095"}]}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:04:50.518004 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1864974262", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "151cdbb9-618f-46a1-a7b5-564e53db9cea"}], "security_groups": [{"name": "tempest-securitygroup--1780342500"}], "key_name": "tempest-keypair-389962117", "user_data": "}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:04:50.569056 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.network.neutron [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] validate_networks() for [('26d75899-1607-4d4e-b529-22178d34e095', None, None, None, None, None)] {{(pid=117782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:04:51.017056 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] validate_networks() for [('151cdbb9-618f-46a1-a7b5-564e53db9cea', None, None, None, None, None)] {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:04:52.974968 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Flavor limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:04:52.975533 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Image limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:04:52.975864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Flavor pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:04:52.976838 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Image pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:04:52.977268 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:04:53.005122 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:53.007216 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:53.011177 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:53.013133 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:53.134399 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Getting quotas for project 23078d86cd394c749328fb9dd7992919. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:04:53.140963 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Getting quotas for user 99e31454d9aa47f38f09f016399f9b86 and project 23078d86cd394c749328fb9dd7992919. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:04:53.168482 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Going to run 1 instances... {{(pid=117782) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:04:53.187935 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:04:53.387334 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3e2269f6-9710-4ac1-afae-c312f9c56d9d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.697594 Jun 26 03:04:53.388362 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 7/14] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:04:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:04:53.427000 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:04:53.428241 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:04:53.429052 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:04:53.430416 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:04:53.430997 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:04:53.451203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:53.452728 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:53.453741 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:53.455125 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:53.498950 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Getting quotas for project 5dd1a7a651fa4d27a1b6488ca13effca. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:04:53.510700 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Getting quotas for user 430d2efc691e4aae9f96409b081c7e96 and project 5dd1a7a651fa4d27a1b6488ca13effca. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:04:53.541877 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:04:53.549953 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:04:53.774811 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-98a2685a-ecc9-47d6-920e-476abdc60daf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.267577 Jun 26 03:04:53.785108 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 8/15] 10.222.0.13 () {62 vars in 1187 bytes} [Sun Jun 26 03:04:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 3279 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 26 03:04:54.033669 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2094420845", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:04:54.142549 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.network.neutron [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] validate_networks() for [('4d1cf2ab-1c05-4bc5-9daa-428f3ef27012', None, None, None, None, None)] {{(pid=117782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:04:54.216362 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8cf351f9-f978-422b-a9f8-90fce3388677 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Action: 'create', calling method: .version_select at 0x7f582d487700>, body: {"keypair": {"name": "tempest-keypair-919588260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyTGJvDzdupmuP+F4eYgfjlyjFdj5qih7qeubIazHT7QGT3vym+/xK+m9Wejb7G+CTw0gkQwIFUB+VDpXSvZnfTq+R7KSMcsgtKlvw+lnI0onLOmSpmvsIH9ZnM3192ig=="}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:04:54.262292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-8cf351f9-f978-422b-a9f8-90fce3388677 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for project 1850f9f425294a82add8a09690dc1df0. Resources: {'key_pairs'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:04:54.278581 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-8cf351f9-f978-422b-a9f8-90fce3388677 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for user 3b7a90ca5e374fc882b644e34e0a3015 and project 1850f9f425294a82add8a09690dc1df0. Resources: {'key_pairs'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:04:54.383855 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8cf351f9-f978-422b-a9f8-90fce3388677 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.593351 Jun 26 03:04:54.384558 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 9/16] 10.222.0.13 () {60 vars in 1158 bytes} [Sun Jun 26 03:04:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:04:54.397519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-357a41da-d79c-4d29-ba0a-a0cb0b5f8e9b tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:54.409365 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-357a41da-d79c-4d29-ba0a-a0cb0b5f8e9b tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:04:54.737118 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-357a41da-d79c-4d29-ba0a-a0cb0b5f8e9b tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:54.802014 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-357a41da-d79c-4d29-ba0a-a0cb0b5f8e9b tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1214 microversion: 2.1 time: 0.405402 Jun 26 03:04:54.802743 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 10/17] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:04:54 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1214 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:04:54.822098 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-14cb8de1-055b-42ae-a163-d7a4855e1c55 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:54.822926 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-14cb8de1-055b-42ae-a163-d7a4855e1c55 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:04:55.043809 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-14cb8de1-055b-42ae-a163-d7a4855e1c55 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:55.051849 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-14cb8de1-055b-42ae-a163-d7a4855e1c55 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:55.060441 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-14cb8de1-055b-42ae-a163-d7a4855e1c55 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:55.062162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-14cb8de1-055b-42ae-a163-d7a4855e1c55 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1281 microversion: 2.20 time: 0.254719 Jun 26 03:04:55.062727 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 11/18] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:04:54 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1281 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:04:55.089670 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1195019093", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "74573779-88f3-4aaa-82c6-e30fd16eafe2"}], "security_groups": [{"name": "tempest-securitygroup--609336291"}], "key_name": "tempest-keypair-1875808098", "user_data": "}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:04:55.453955 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] validate_networks() for [('74573779-88f3-4aaa-82c6-e30fd16eafe2', None, None, None, None, None)] {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:04:56.034153 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Flavor limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:04:56.034629 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Image limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:04:56.035076 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Flavor pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:04:56.035654 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Image pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:04:56.036075 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:04:56.058597 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:56.059049 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:56.063576 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:56.065401 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:56.149399 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Getting quotas for project aa1dff9e9be549308ec0ad3a13810062. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:04:56.162589 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Getting quotas for user a1313e0937b842059f1e01480c98351c and project aa1dff9e9be549308ec0ad3a13810062. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:04:56.232345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Going to run 1 instances... {{(pid=117782) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:04:56.241499 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:04:56.428700 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3233a4b5-5957-4900-b0ed-86b9b139e184 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.037592 Jun 26 03:04:56.434863 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 8/19] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:04:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 3046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:04:56.457497 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9635003f-152b-4fe3-8a6b-1b943bc0fe9a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:56.460478 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9635003f-152b-4fe3-8a6b-1b943bc0fe9a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:04:56.541011 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9635003f-152b-4fe3-8a6b-1b943bc0fe9a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:56.543174 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9635003f-152b-4fe3-8a6b-1b943bc0fe9a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:56.544246 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9635003f-152b-4fe3-8a6b-1b943bc0fe9a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:56.558549 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9635003f-152b-4fe3-8a6b-1b943bc0fe9a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:56.898437 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9635003f-152b-4fe3-8a6b-1b943bc0fe9a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:56.917118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9635003f-152b-4fe3-8a6b-1b943bc0fe9a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1218 microversion: 2.1 time: 0.480817 Jun 26 03:04:56.918015 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 9/20] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:04:56 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1218 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:04:56.930690 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:04:56.931994 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:04:56.932880 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:04:56.934682 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:04:56.935329 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:04:56.943920 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7f3109bd-305e-4089-be55-63c2a8126387 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:56.950866 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7f3109bd-305e-4089-be55-63c2a8126387 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:04:56.973865 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:56.974383 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:56.977720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7f3109bd-305e-4089-be55-63c2a8126387 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:56.978239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7f3109bd-305e-4089-be55-63c2a8126387 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:56.979679 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:56.980640 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:56.982878 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7f3109bd-305e-4089-be55-63c2a8126387 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:56.983999 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7f3109bd-305e-4089-be55-63c2a8126387 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:57.027037 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Getting quotas for project ea86edd65ecb4972ba8bb33b34387432. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:04:57.042129 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Getting quotas for user 95793ccb15844069890363d983f1680d and project ea86edd65ecb4972ba8bb33b34387432. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:04:57.103710 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:04:57.109041 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:04:57.140559 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7f3109bd-305e-4089-be55-63c2a8126387 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:57.152922 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7f3109bd-305e-4089-be55-63c2a8126387 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:57.157837 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7f3109bd-305e-4089-be55-63c2a8126387 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:57.160329 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-7f3109bd-305e-4089-be55-63c2a8126387 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1285 microversion: 2.20 time: 0.240786 Jun 26 03:04:57.174767 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 10/21] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:04:56 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1285 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:04:57.182097 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f8d03c8e-85b2-44d2-ae13-873a631cc324 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:57.183008 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f8d03c8e-85b2-44d2-ae13-873a631cc324 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:04:57.189712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f16e143c-cd12-43c9-ab3c-6c69e62e22b7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.112772 Jun 26 03:04:57.190991 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 12/22] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:04:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 2128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:04:57.211328 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f19bab78-1f4a-4c94-961e-b6899be993bc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:57.215364 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f19bab78-1f4a-4c94-961e-b6899be993bc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:04:57.273515 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f8d03c8e-85b2-44d2-ae13-873a631cc324 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:57.293908 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f8d03c8e-85b2-44d2-ae13-873a631cc324 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1222 microversion: 2.1 time: 0.117059 Jun 26 03:04:57.296002 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:04:57 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:04:57.331676 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f19bab78-1f4a-4c94-961e-b6899be993bc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:57.363325 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f19bab78-1f4a-4c94-961e-b6899be993bc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1238 microversion: 2.1 time: 0.165300 Jun 26 03:04:57.375179 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 13/24] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:04:57 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1238 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:04:57.504023 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-217916542", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:04:57.677986 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.network.neutron [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] validate_networks() for [('4d1cf2ab-1c05-4bc5-9daa-428f3ef27012', None, None, None, None, None)] {{(pid=117782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:04:57.938981 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0f468a59-3382-4175-a84b-b129d4149fd5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:57.939743 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0f468a59-3382-4175-a84b-b129d4149fd5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:04:57.970424 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0f468a59-3382-4175-a84b-b129d4149fd5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:57.971469 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0f468a59-3382-4175-a84b-b129d4149fd5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:57.977804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0f468a59-3382-4175-a84b-b129d4149fd5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:57.979702 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0f468a59-3382-4175-a84b-b129d4149fd5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:58.546907 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0f468a59-3382-4175-a84b-b129d4149fd5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:58.567064 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0f468a59-3382-4175-a84b-b129d4149fd5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1218 microversion: 2.1 time: 0.635389 Jun 26 03:04:58.569985 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 14/25] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:04:57 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1218 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:04:58.584109 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-34e398b5-1a4d-45e3-8b30-b011b6cfea7e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:58.587072 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-34e398b5-1a4d-45e3-8b30-b011b6cfea7e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:04:58.607008 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-34e398b5-1a4d-45e3-8b30-b011b6cfea7e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:58.609113 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-34e398b5-1a4d-45e3-8b30-b011b6cfea7e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:58.611906 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-34e398b5-1a4d-45e3-8b30-b011b6cfea7e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:58.613559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-34e398b5-1a4d-45e3-8b30-b011b6cfea7e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:58.718397 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Flavor limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:04:58.718988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Image limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:04:58.719868 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Flavor pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:04:58.720405 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Image pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:04:58.720937 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:04:58.738933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:58.742275 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:58.743401 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:58.746096 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:58.768579 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Getting quotas for project aa1dff9e9be549308ec0ad3a13810062. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:04:58.773383 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Getting quotas for user a1313e0937b842059f1e01480c98351c and project aa1dff9e9be549308ec0ad3a13810062. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:04:58.786385 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Going to run 1 instances... {{(pid=117782) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:04:58.789238 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:04:58.789769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-34e398b5-1a4d-45e3-8b30-b011b6cfea7e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:58.801363 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-34e398b5-1a4d-45e3-8b30-b011b6cfea7e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:58.804008 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-34e398b5-1a4d-45e3-8b30-b011b6cfea7e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:58.806705 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-34e398b5-1a4d-45e3-8b30-b011b6cfea7e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1277 microversion: 2.20 time: 0.232951 Jun 26 03:04:58.807415 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 15/26] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:04:58 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:04:58.825475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c4385092-bc5c-4bfa-a566-e8c5ac6ad3c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:58.826144 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c4385092-bc5c-4bfa-a566-e8c5ac6ad3c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:04:58.833917 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c4385092-bc5c-4bfa-a566-e8c5ac6ad3c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:58.834542 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c4385092-bc5c-4bfa-a566-e8c5ac6ad3c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:58.835332 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c4385092-bc5c-4bfa-a566-e8c5ac6ad3c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:58.835938 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c4385092-bc5c-4bfa-a566-e8c5ac6ad3c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:58.871490 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-15edba86-987f-4c4f-900b-e940f9a8cfc8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.368383 Jun 26 03:04:58.880619 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 12/27] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:04:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:04:58.892141 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1784343213", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02cd0f74-99cd-4eb9-aeb7-aae2b7255a50"}], "security_groups": [{"name": "tempest-securitygroup--374171752"}], "key_name": "tempest-keypair-919588260", "user_data": "}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:04:58.942483 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c4385092-bc5c-4bfa-a566-e8c5ac6ad3c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:58.951359 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c4385092-bc5c-4bfa-a566-e8c5ac6ad3c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1234 microversion: 2.1 time: 0.131015 Jun 26 03:04:58.961964 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 16/28] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:04:58 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1234 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:04:58.966626 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3deea20a-1dd2-4b1b-bec5-8c328a009dc5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:58.967300 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3deea20a-1dd2-4b1b-bec5-8c328a009dc5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:04:59.093795 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3deea20a-1dd2-4b1b-bec5-8c328a009dc5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:59.107344 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3deea20a-1dd2-4b1b-bec5-8c328a009dc5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1221 microversion: 2.1 time: 0.145197 Jun 26 03:04:59.108699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 17/29] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:04:58 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1221 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:04:59.153195 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.network.neutron [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] validate_networks() for [('02cd0f74-99cd-4eb9-aeb7-aae2b7255a50', None, None, None, None, None)] {{(pid=117782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:04:59.591575 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2ce29ac2-f6a4-4eeb-98d3-f7cd211374f3 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:59.592768 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2ce29ac2-f6a4-4eeb-98d3-f7cd211374f3 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:04:59.619283 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2ce29ac2-f6a4-4eeb-98d3-f7cd211374f3 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:59.619821 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2ce29ac2-f6a4-4eeb-98d3-f7cd211374f3 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:59.620656 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2ce29ac2-f6a4-4eeb-98d3-f7cd211374f3 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:59.621110 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2ce29ac2-f6a4-4eeb-98d3-f7cd211374f3 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:59.734071 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-2ce29ac2-f6a4-4eeb-98d3-f7cd211374f3 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:04:59.750616 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2ce29ac2-f6a4-4eeb-98d3-f7cd211374f3 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1266 microversion: 2.1 time: 0.168650 Jun 26 03:04:59.751460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 18/30] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:04:59 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:04:59.826696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Flavor limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:04:59.827175 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Image limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:04:59.827712 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Flavor pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:04:59.828134 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Image pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:04:59.828599 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:04:59.831989 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4652bcfc-65b6-45f6-bf07-67e2c7df6b1d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:04:59.832851 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4652bcfc-65b6-45f6-bf07-67e2c7df6b1d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:04:59.853475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4652bcfc-65b6-45f6-bf07-67e2c7df6b1d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:59.854379 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4652bcfc-65b6-45f6-bf07-67e2c7df6b1d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:59.855388 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4652bcfc-65b6-45f6-bf07-67e2c7df6b1d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:59.857442 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:59.858586 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:59.859493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:04:59.860881 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4652bcfc-65b6-45f6-bf07-67e2c7df6b1d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:59.861518 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:04:59.913043 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for project 1850f9f425294a82add8a09690dc1df0. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:04:59.927341 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for user 3b7a90ca5e374fc882b644e34e0a3015 and project 1850f9f425294a82add8a09690dc1df0. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:04:59.955541 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Going to run 1 instances... {{(pid=117782) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:04:59.966670 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:05:00.014871 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4652bcfc-65b6-45f6-bf07-67e2c7df6b1d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:00.030264 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4652bcfc-65b6-45f6-bf07-67e2c7df6b1d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:00.038727 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4652bcfc-65b6-45f6-bf07-67e2c7df6b1d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:00.042120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4652bcfc-65b6-45f6-bf07-67e2c7df6b1d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1341 microversion: 2.20 time: 0.214287 Jun 26 03:05:00.043612 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 19/31] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:04:59 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1341 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:00.063744 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e2ed2e0e-fa2c-4e23-8c13-d6d2d2c60d64 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:00.066941 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e2ed2e0e-fa2c-4e23-8c13-d6d2d2c60d64 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:00.094614 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5990189d-aaf9-4ffe-9d37-febc2c1c445b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.208015 Jun 26 03:05:00.095795 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 13/32] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:04:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:05:00.109882 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e2ed2e0e-fa2c-4e23-8c13-d6d2d2c60d64 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:00.110501 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e2ed2e0e-fa2c-4e23-8c13-d6d2d2c60d64 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:00.113338 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-07f53d21-1bec-4880-b370-0f4b54093089 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:00.114404 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e2ed2e0e-fa2c-4e23-8c13-d6d2d2c60d64 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:00.117468 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e2ed2e0e-fa2c-4e23-8c13-d6d2d2c60d64 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:00.126639 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-07f53d21-1bec-4880-b370-0f4b54093089 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:00.136116 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:00.484711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-07f53d21-1bec-4880-b370-0f4b54093089 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:00.507475 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-07f53d21-1bec-4880-b370-0f4b54093089 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1241 microversion: 2.1 time: 0.404223 Jun 26 03:05:00.522227 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 14/33] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:00 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1241 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:00.541778 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-39aacf9c-11e6-48cc-a743-1746e88b0eae tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:00.556178 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-39aacf9c-11e6-48cc-a743-1746e88b0eae tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:00.567523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e2ed2e0e-fa2c-4e23-8c13-d6d2d2c60d64 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:00.577567 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e2ed2e0e-fa2c-4e23-8c13-d6d2d2c60d64 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1290 microversion: 2.1 time: 0.532872 Jun 26 03:05:00.587363 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-39aacf9c-11e6-48cc-a743-1746e88b0eae tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:00.593363 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-39aacf9c-11e6-48cc-a743-1746e88b0eae tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:00.601668 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-39aacf9c-11e6-48cc-a743-1746e88b0eae tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:00.602771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-39aacf9c-11e6-48cc-a743-1746e88b0eae tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:00.609539 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 20/34] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:00 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1290 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:00.770933 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d6c24879-b84a-49ff-8f14-86f68dcf22a8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:00.777038 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d6c24879-b84a-49ff-8f14-86f68dcf22a8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:00.788490 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d6c24879-b84a-49ff-8f14-86f68dcf22a8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:00.790825 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d6c24879-b84a-49ff-8f14-86f68dcf22a8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:00.797195 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d6c24879-b84a-49ff-8f14-86f68dcf22a8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:00.797929 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d6c24879-b84a-49ff-8f14-86f68dcf22a8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:00.836368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-39aacf9c-11e6-48cc-a743-1746e88b0eae tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:00.844259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-39aacf9c-11e6-48cc-a743-1746e88b0eae tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1217 microversion: 2.1 time: 0.312994 Jun 26 03:05:00.856072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 15/35] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:00 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1217 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:01.048180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d6c24879-b84a-49ff-8f14-86f68dcf22a8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:01.064237 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d0aaed4e-7352-415b-a594-ca9676867ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:01.065210 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d0aaed4e-7352-415b-a594-ca9676867ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:01.084610 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d0aaed4e-7352-415b-a594-ca9676867ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:01.092557 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d0aaed4e-7352-415b-a594-ca9676867ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:01.093854 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d0aaed4e-7352-415b-a594-ca9676867ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:01.094761 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d0aaed4e-7352-415b-a594-ca9676867ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:01.097525 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d6c24879-b84a-49ff-8f14-86f68dcf22a8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1284 microversion: 2.1 time: 0.330339 Jun 26 03:05:01.100363 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 21/36] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:00 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1284 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:01.505442 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d0aaed4e-7352-415b-a594-ca9676867ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:01.527807 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-bd9a77c6-8e13-4eee-8450-36be3b728582 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:01.528474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-bd9a77c6-8e13-4eee-8450-36be3b728582 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:01.544496 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d0aaed4e-7352-415b-a594-ca9676867ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:01.545403 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd9a77c6-8e13-4eee-8450-36be3b728582 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:01.546192 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd9a77c6-8e13-4eee-8450-36be3b728582 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:01.547435 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd9a77c6-8e13-4eee-8450-36be3b728582 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:01.548075 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd9a77c6-8e13-4eee-8450-36be3b728582 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:01.549373 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d0aaed4e-7352-415b-a594-ca9676867ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:01.550569 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d0aaed4e-7352-415b-a594-ca9676867ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1339 microversion: 2.20 time: 0.491679 Jun 26 03:05:01.558945 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 16/37] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:01 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1339 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:01.626903 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1af3aa10-780c-407e-9460-3a5d5ae34b9c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:01.627628 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1af3aa10-780c-407e-9460-3a5d5ae34b9c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:01.644633 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1af3aa10-780c-407e-9460-3a5d5ae34b9c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:01.647099 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1af3aa10-780c-407e-9460-3a5d5ae34b9c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:01.648107 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1af3aa10-780c-407e-9460-3a5d5ae34b9c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:01.653702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1af3aa10-780c-407e-9460-3a5d5ae34b9c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:01.865298 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1af3aa10-780c-407e-9460-3a5d5ae34b9c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:01.868048 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bd9a77c6-8e13-4eee-8450-36be3b728582 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:01.876333 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-bd9a77c6-8e13-4eee-8450-36be3b728582 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1245 microversion: 2.1 time: 0.352769 Jun 26 03:05:01.880914 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 22/38] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:01 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1245 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:01.892268 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1af3aa10-780c-407e-9460-3a5d5ae34b9c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1296 microversion: 2.1 time: 0.256840 Jun 26 03:05:01.893150 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 17/39] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:01 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1296 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:01.908412 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0fd98ffa-c5c3-493a-9e79-b936bf3b7ebb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:01.909105 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0fd98ffa-c5c3-493a-9e79-b936bf3b7ebb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:01.922688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0fd98ffa-c5c3-493a-9e79-b936bf3b7ebb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:01.923120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0fd98ffa-c5c3-493a-9e79-b936bf3b7ebb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:01.923897 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0fd98ffa-c5c3-493a-9e79-b936bf3b7ebb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:01.932179 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0fd98ffa-c5c3-493a-9e79-b936bf3b7ebb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:02.116073 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1bda0ab3-1da5-4ca3-bc1d-7c7b8bc6a213 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:02.116701 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1bda0ab3-1da5-4ca3-bc1d-7c7b8bc6a213 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:02.135074 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1bda0ab3-1da5-4ca3-bc1d-7c7b8bc6a213 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:02.135534 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1bda0ab3-1da5-4ca3-bc1d-7c7b8bc6a213 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:02.144116 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1bda0ab3-1da5-4ca3-bc1d-7c7b8bc6a213 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:02.144582 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1bda0ab3-1da5-4ca3-bc1d-7c7b8bc6a213 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:02.206093 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0fd98ffa-c5c3-493a-9e79-b936bf3b7ebb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:02.218686 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0fd98ffa-c5c3-493a-9e79-b936bf3b7ebb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1273 microversion: 2.1 time: 0.332113 Jun 26 03:05:02.224471 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 23/40] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:01 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:02.514526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1bda0ab3-1da5-4ca3-bc1d-7c7b8bc6a213 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:02.530374 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1bda0ab3-1da5-4ca3-bc1d-7c7b8bc6a213 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1272 microversion: 2.1 time: 0.418946 Jun 26 03:05:02.531583 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 18/41] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:02 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1272 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:02.576476 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8d94cee4-d2de-4044-90db-f5cfa5c87ce7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:02.578163 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8d94cee4-d2de-4044-90db-f5cfa5c87ce7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:02.603090 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8d94cee4-d2de-4044-90db-f5cfa5c87ce7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:02.606112 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8d94cee4-d2de-4044-90db-f5cfa5c87ce7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:02.611833 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8d94cee4-d2de-4044-90db-f5cfa5c87ce7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:02.637078 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8d94cee4-d2de-4044-90db-f5cfa5c87ce7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:02.901963 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-11dcc579-be78-4f37-b9d1-5e5711ebac1a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:02.903548 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-11dcc579-be78-4f37-b9d1-5e5711ebac1a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:02.915110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-11dcc579-be78-4f37-b9d1-5e5711ebac1a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:02.927342 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-11dcc579-be78-4f37-b9d1-5e5711ebac1a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:02.931796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-11dcc579-be78-4f37-b9d1-5e5711ebac1a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:02.932491 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-11dcc579-be78-4f37-b9d1-5e5711ebac1a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:03.319093 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-8d94cee4-d2de-4044-90db-f5cfa5c87ce7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:03.344436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-8d94cee4-d2de-4044-90db-f5cfa5c87ce7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:03.356689 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-8d94cee4-d2de-4044-90db-f5cfa5c87ce7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:03.356689 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8d94cee4-d2de-4044-90db-f5cfa5c87ce7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1339 microversion: 2.20 time: 0.775905 Jun 26 03:05:03.356689 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 24/42] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:02 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1339 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:03.365274 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-399e0373-e939-4ce8-a042-27d0a2a92768 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:03.367415 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-399e0373-e939-4ce8-a042-27d0a2a92768 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:03.374876 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-399e0373-e939-4ce8-a042-27d0a2a92768 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:03.375414 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-399e0373-e939-4ce8-a042-27d0a2a92768 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:03.376264 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-399e0373-e939-4ce8-a042-27d0a2a92768 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:03.376769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-399e0373-e939-4ce8-a042-27d0a2a92768 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:03.747067 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-399e0373-e939-4ce8-a042-27d0a2a92768 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:03.762487 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-399e0373-e939-4ce8-a042-27d0a2a92768 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1296 microversion: 2.1 time: 0.408366 Jun 26 03:05:03.764657 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 25/43] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:03 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1296 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:03.769471 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-7420e669-f62d-4c63-b759-139125762f12 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:03.773637 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-7420e669-f62d-4c63-b759-139125762f12 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:03.785590 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-11dcc579-be78-4f37-b9d1-5e5711ebac1a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:03.792602 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7420e669-f62d-4c63-b759-139125762f12 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:03.793408 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7420e669-f62d-4c63-b759-139125762f12 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:03.794448 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7420e669-f62d-4c63-b759-139125762f12 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:03.795228 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7420e669-f62d-4c63-b759-139125762f12 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:03.797463 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-11dcc579-be78-4f37-b9d1-5e5711ebac1a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1301 microversion: 2.1 time: 0.900266 Jun 26 03:05:03.819379 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 19/44] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:02 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1301 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:03.835342 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1475ae51-916a-4bc6-9643-e687a5af40ac tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:03.836201 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1475ae51-916a-4bc6-9643-e687a5af40ac tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:03.848860 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1475ae51-916a-4bc6-9643-e687a5af40ac tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:03.850022 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1475ae51-916a-4bc6-9643-e687a5af40ac tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:03.851118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1475ae51-916a-4bc6-9643-e687a5af40ac tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:03.853878 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1475ae51-916a-4bc6-9643-e687a5af40ac tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:03.992900 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-7420e669-f62d-4c63-b759-139125762f12 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:04.003611 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-7420e669-f62d-4c63-b759-139125762f12 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.237705 Jun 26 03:05:04.007997 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 26/45] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:03 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:04.018503 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1475ae51-916a-4bc6-9643-e687a5af40ac tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:04.034470 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1475ae51-916a-4bc6-9643-e687a5af40ac tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1272 microversion: 2.1 time: 0.204714 Jun 26 03:05:04.036591 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 20/46] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:03 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:04.370488 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-53a478c1-cfcd-4387-92bf-2762c72ef6f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:04.371677 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-53a478c1-cfcd-4387-92bf-2762c72ef6f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:04.379430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-53a478c1-cfcd-4387-92bf-2762c72ef6f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:04.386476 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-53a478c1-cfcd-4387-92bf-2762c72ef6f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:04.393728 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-53a478c1-cfcd-4387-92bf-2762c72ef6f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:04.394439 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-53a478c1-cfcd-4387-92bf-2762c72ef6f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:04.581149 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-53a478c1-cfcd-4387-92bf-2762c72ef6f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:04.599174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-53a478c1-cfcd-4387-92bf-2762c72ef6f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:04.603534 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-53a478c1-cfcd-4387-92bf-2762c72ef6f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:04.604723 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-53a478c1-cfcd-4387-92bf-2762c72ef6f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1339 microversion: 2.20 time: 0.238495 Jun 26 03:05:04.615608 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 27/47] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:04 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1339 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:04.783011 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d4e93e73-ffcf-4f68-b4b9-227300fe75fc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:04.784706 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d4e93e73-ffcf-4f68-b4b9-227300fe75fc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:04.808673 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4e93e73-ffcf-4f68-b4b9-227300fe75fc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:04.809140 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4e93e73-ffcf-4f68-b4b9-227300fe75fc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:04.809936 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4e93e73-ffcf-4f68-b4b9-227300fe75fc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:04.810408 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4e93e73-ffcf-4f68-b4b9-227300fe75fc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:04.832726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-bc2fe070-fbcf-4f82-8a92-ea6894670bdd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:04.834109 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-bc2fe070-fbcf-4f82-8a92-ea6894670bdd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:04.841754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc2fe070-fbcf-4f82-8a92-ea6894670bdd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:04.844241 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc2fe070-fbcf-4f82-8a92-ea6894670bdd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:04.845264 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc2fe070-fbcf-4f82-8a92-ea6894670bdd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:04.846373 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc2fe070-fbcf-4f82-8a92-ea6894670bdd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:05.075873 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bc2fe070-fbcf-4f82-8a92-ea6894670bdd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:05.087611 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-bc2fe070-fbcf-4f82-8a92-ea6894670bdd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1311 microversion: 2.1 time: 0.259040 Jun 26 03:05:05.098650 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 28/48] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:04 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1311 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:05.104747 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-42af6e0c-abe0-4688-836c-4fcc664fd44a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:05.105910 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-42af6e0c-abe0-4688-836c-4fcc664fd44a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:05.113796 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-42af6e0c-abe0-4688-836c-4fcc664fd44a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:05.114822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-42af6e0c-abe0-4688-836c-4fcc664fd44a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:05.116145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-42af6e0c-abe0-4688-836c-4fcc664fd44a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:05.116780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-42af6e0c-abe0-4688-836c-4fcc664fd44a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:05.263621 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-42af6e0c-abe0-4688-836c-4fcc664fd44a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:05.277034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-42af6e0c-abe0-4688-836c-4fcc664fd44a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.174892 Jun 26 03:05:05.291595 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 29/49] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:05 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:05.291595 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d59960c9-b178-4eb4-be86-6a4365aaaa12 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:05.291595 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d59960c9-b178-4eb4-be86-6a4365aaaa12 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:05.297626 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d59960c9-b178-4eb4-be86-6a4365aaaa12 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:05.298544 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d59960c9-b178-4eb4-be86-6a4365aaaa12 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:05.299481 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d59960c9-b178-4eb4-be86-6a4365aaaa12 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:05.300067 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d59960c9-b178-4eb4-be86-6a4365aaaa12 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:05.387453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d4e93e73-ffcf-4f68-b4b9-227300fe75fc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:05.405309 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d4e93e73-ffcf-4f68-b4b9-227300fe75fc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.626122 Jun 26 03:05:05.413147 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 21/50] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:04 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:05.537462 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d59960c9-b178-4eb4-be86-6a4365aaaa12 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:05.541431 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=100 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:05.548676 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d59960c9-b178-4eb4-be86-6a4365aaaa12 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.263661 Jun 26 03:05:05.549485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 30/51] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:05 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:05.624839 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5b5e8dbc-04e8-4111-a1dd-71fb350d9417 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:05.625464 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5b5e8dbc-04e8-4111-a1dd-71fb350d9417 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:05.631910 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5b5e8dbc-04e8-4111-a1dd-71fb350d9417 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:05.632377 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5b5e8dbc-04e8-4111-a1dd-71fb350d9417 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:05.633630 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5b5e8dbc-04e8-4111-a1dd-71fb350d9417 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:05.634125 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5b5e8dbc-04e8-4111-a1dd-71fb350d9417 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:05.783699 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5b5e8dbc-04e8-4111-a1dd-71fb350d9417 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:05.792654 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5b5e8dbc-04e8-4111-a1dd-71fb350d9417 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:05.794282 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5b5e8dbc-04e8-4111-a1dd-71fb350d9417 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:05.795463 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5b5e8dbc-04e8-4111-a1dd-71fb350d9417 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.175740 Jun 26 03:05:05.806472 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 22/52] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:05 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:06.105702 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-cf01d88d-0783-4982-8e79-37bf82d3089b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:06.107553 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-cf01d88d-0783-4982-8e79-37bf82d3089b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:06.124647 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cf01d88d-0783-4982-8e79-37bf82d3089b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:06.125015 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cf01d88d-0783-4982-8e79-37bf82d3089b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:06.126725 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cf01d88d-0783-4982-8e79-37bf82d3089b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:06.127326 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cf01d88d-0783-4982-8e79-37bf82d3089b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:06.207743 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-cf01d88d-0783-4982-8e79-37bf82d3089b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:06.217246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-cf01d88d-0783-4982-8e79-37bf82d3089b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1311 microversion: 2.1 time: 0.115779 Jun 26 03:05:06.217863 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 31/53] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:06 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1311 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:06.299205 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-586e015e-4346-48e0-90f8-b897f913d8c9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:06.300004 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-586e015e-4346-48e0-90f8-b897f913d8c9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:06.306845 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-586e015e-4346-48e0-90f8-b897f913d8c9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:06.307306 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-586e015e-4346-48e0-90f8-b897f913d8c9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:06.308169 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-586e015e-4346-48e0-90f8-b897f913d8c9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:06.308603 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-586e015e-4346-48e0-90f8-b897f913d8c9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:06.380127 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-586e015e-4346-48e0-90f8-b897f913d8c9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:06.387620 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-586e015e-4346-48e0-90f8-b897f913d8c9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.092442 Jun 26 03:05:06.388273 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 23/54] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:06 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:06.423780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fb04b699-2230-43f4-be98-8c6ca9cc45be tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:06.424482 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fb04b699-2230-43f4-be98-8c6ca9cc45be tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:06.429501 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:06.431584 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb04b699-2230-43f4-be98-8c6ca9cc45be tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:06.432393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb04b699-2230-43f4-be98-8c6ca9cc45be tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:06.433657 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb04b699-2230-43f4-be98-8c6ca9cc45be tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:06.434144 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb04b699-2230-43f4-be98-8c6ca9cc45be tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:06.568750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-47964001-7917-4e2a-b31b-8e8467f83fab tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:06.570078 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-47964001-7917-4e2a-b31b-8e8467f83fab tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:06.580774 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-47964001-7917-4e2a-b31b-8e8467f83fab tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:06.581357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fb04b699-2230-43f4-be98-8c6ca9cc45be tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:06.582280 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-47964001-7917-4e2a-b31b-8e8467f83fab tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:06.585029 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-47964001-7917-4e2a-b31b-8e8467f83fab tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:06.594889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-47964001-7917-4e2a-b31b-8e8467f83fab tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:06.603013 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fb04b699-2230-43f4-be98-8c6ca9cc45be tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.183563 Jun 26 03:05:06.604032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 32/55] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:06 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:06.819938 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-19cbecbb-52ee-4985-8345-ee682c714871 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:06.820637 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-19cbecbb-52ee-4985-8345-ee682c714871 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:06.827203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-19cbecbb-52ee-4985-8345-ee682c714871 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:06.827656 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-19cbecbb-52ee-4985-8345-ee682c714871 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:06.828426 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-19cbecbb-52ee-4985-8345-ee682c714871 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:06.830561 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-19cbecbb-52ee-4985-8345-ee682c714871 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:06.853661 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-47964001-7917-4e2a-b31b-8e8467f83fab tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:06.865182 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-47964001-7917-4e2a-b31b-8e8467f83fab tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.299599 Jun 26 03:05:06.868659 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 24/56] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:06 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:07.004738 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=4 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:07.057248 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-19cbecbb-52ee-4985-8345-ee682c714871 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:07.068882 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-19cbecbb-52ee-4985-8345-ee682c714871 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:07.071038 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-19cbecbb-52ee-4985-8345-ee682c714871 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:07.073324 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-19cbecbb-52ee-4985-8345-ee682c714871 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.262812 Jun 26 03:05:07.074669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 33/57] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:06 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:05:07.234703 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-72ba488b-8f6e-4b7a-9bb6-5674c79f673f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:07.235775 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-72ba488b-8f6e-4b7a-9bb6-5674c79f673f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:07.249386 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-72ba488b-8f6e-4b7a-9bb6-5674c79f673f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:07.250183 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-72ba488b-8f6e-4b7a-9bb6-5674c79f673f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:07.256361 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-72ba488b-8f6e-4b7a-9bb6-5674c79f673f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:07.257130 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-72ba488b-8f6e-4b7a-9bb6-5674c79f673f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:07.407160 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-72ba488b-8f6e-4b7a-9bb6-5674c79f673f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:07.415092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-45a01d85-ae6e-436f-a087-fa042313bc46 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:07.416795 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-45a01d85-ae6e-436f-a087-fa042313bc46 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:07.417060 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-72ba488b-8f6e-4b7a-9bb6-5674c79f673f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1311 microversion: 2.1 time: 0.186673 Jun 26 03:05:07.417483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 25/58] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:07 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1311 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:07.430486 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-45a01d85-ae6e-436f-a087-fa042313bc46 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:07.432312 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-45a01d85-ae6e-436f-a087-fa042313bc46 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:07.434840 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-45a01d85-ae6e-436f-a087-fa042313bc46 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:07.436035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-45a01d85-ae6e-436f-a087-fa042313bc46 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:07.570306 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-45a01d85-ae6e-436f-a087-fa042313bc46 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:07.583582 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-45a01d85-ae6e-436f-a087-fa042313bc46 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.181441 Jun 26 03:05:07.585691 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 34/59] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:07 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:07.621535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-20c04f30-a7ed-4ed2-8a15-eb48a7181f11 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:07.622620 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-20c04f30-a7ed-4ed2-8a15-eb48a7181f11 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:07.640817 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-20c04f30-a7ed-4ed2-8a15-eb48a7181f11 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:07.643012 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-20c04f30-a7ed-4ed2-8a15-eb48a7181f11 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:07.645446 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-20c04f30-a7ed-4ed2-8a15-eb48a7181f11 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:07.646635 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-20c04f30-a7ed-4ed2-8a15-eb48a7181f11 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:07.888471 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3712a140-299b-4d39-b72a-076a0fcc49dd tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:07.889630 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3712a140-299b-4d39-b72a-076a0fcc49dd tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:07.901795 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3712a140-299b-4d39-b72a-076a0fcc49dd tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:07.904109 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3712a140-299b-4d39-b72a-076a0fcc49dd tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:07.911319 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3712a140-299b-4d39-b72a-076a0fcc49dd tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:07.912439 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3712a140-299b-4d39-b72a-076a0fcc49dd tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:08.091273 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-20c04f30-a7ed-4ed2-8a15-eb48a7181f11 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:08.100294 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-20c04f30-a7ed-4ed2-8a15-eb48a7181f11 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.483908 Jun 26 03:05:08.100879 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 26/60] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:07 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:08.114079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-30f9c0b2-3c44-4d78-b2ea-c5442f774767 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:08.114947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-30f9c0b2-3c44-4d78-b2ea-c5442f774767 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:08.122542 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-30f9c0b2-3c44-4d78-b2ea-c5442f774767 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:08.123000 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-30f9c0b2-3c44-4d78-b2ea-c5442f774767 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:08.123862 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-30f9c0b2-3c44-4d78-b2ea-c5442f774767 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:08.124305 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-30f9c0b2-3c44-4d78-b2ea-c5442f774767 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:08.231608 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3712a140-299b-4d39-b72a-076a0fcc49dd tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:08.254478 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3712a140-299b-4d39-b72a-076a0fcc49dd tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.370869 Jun 26 03:05:08.268494 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 35/61] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:07 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:08.435396 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f617f9bf-d7da-4eb9-bef1-aec9853c1d7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:08.436218 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f617f9bf-d7da-4eb9-bef1-aec9853c1d7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:08.452076 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f617f9bf-d7da-4eb9-bef1-aec9853c1d7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:08.453337 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f617f9bf-d7da-4eb9-bef1-aec9853c1d7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:08.455307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f617f9bf-d7da-4eb9-bef1-aec9853c1d7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:08.455765 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f617f9bf-d7da-4eb9-bef1-aec9853c1d7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:08.614378 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f617f9bf-d7da-4eb9-bef1-aec9853c1d7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:08.622980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f617f9bf-d7da-4eb9-bef1-aec9853c1d7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1299 microversion: 2.1 time: 0.193116 Jun 26 03:05:08.632005 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 36/62] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:08 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1299 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:08.639375 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-34437085-a125-4f2b-bd9f-6f2546f2b092 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:08.640202 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-34437085-a125-4f2b-bd9f-6f2546f2b092 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:08.648515 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-34437085-a125-4f2b-bd9f-6f2546f2b092 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:08.648965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-34437085-a125-4f2b-bd9f-6f2546f2b092 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:08.649730 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-34437085-a125-4f2b-bd9f-6f2546f2b092 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:08.650207 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-34437085-a125-4f2b-bd9f-6f2546f2b092 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:08.669295 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-30f9c0b2-3c44-4d78-b2ea-c5442f774767 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:08.682437 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-30f9c0b2-3c44-4d78-b2ea-c5442f774767 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:08.685040 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-30f9c0b2-3c44-4d78-b2ea-c5442f774767 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:08.687459 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-30f9c0b2-3c44-4d78-b2ea-c5442f774767 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.584127 Jun 26 03:05:08.688335 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 27/63] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:08 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:08.749861 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-34437085-a125-4f2b-bd9f-6f2546f2b092 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:08.760109 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-34437085-a125-4f2b-bd9f-6f2546f2b092 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.126740 Jun 26 03:05:08.761306 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 37/64] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:08 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:09.117087 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e24ce4e4-bcbd-4753-b590-c0fcb0aaabc2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:09.117622 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e24ce4e4-bcbd-4753-b590-c0fcb0aaabc2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:09.123680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e24ce4e4-bcbd-4753-b590-c0fcb0aaabc2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:09.124131 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e24ce4e4-bcbd-4753-b590-c0fcb0aaabc2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:09.124900 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e24ce4e4-bcbd-4753-b590-c0fcb0aaabc2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:09.125345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e24ce4e4-bcbd-4753-b590-c0fcb0aaabc2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:09.129489 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=100 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:09.274654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-cdd011e4-5021-4bb6-905d-62a3f6e77ac2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:09.275284 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-cdd011e4-5021-4bb6-905d-62a3f6e77ac2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:09.277141 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=24 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:09.283016 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cdd011e4-5021-4bb6-905d-62a3f6e77ac2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:09.283475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cdd011e4-5021-4bb6-905d-62a3f6e77ac2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:09.284244 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cdd011e4-5021-4bb6-905d-62a3f6e77ac2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:09.284690 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cdd011e4-5021-4bb6-905d-62a3f6e77ac2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:09.292738 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e24ce4e4-bcbd-4753-b590-c0fcb0aaabc2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:09.300642 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e24ce4e4-bcbd-4753-b590-c0fcb0aaabc2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.187581 Jun 26 03:05:09.312664 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 28/65] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:09 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:09.457588 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-cdd011e4-5021-4bb6-905d-62a3f6e77ac2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:09.466070 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-cdd011e4-5021-4bb6-905d-62a3f6e77ac2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.195273 Jun 26 03:05:09.467756 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 38/66] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:09 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:09.648092 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-58573dbd-a576-4fe4-8bfd-27d9e025f459 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:09.648802 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-58573dbd-a576-4fe4-8bfd-27d9e025f459 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:09.655038 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-58573dbd-a576-4fe4-8bfd-27d9e025f459 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:09.655988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-58573dbd-a576-4fe4-8bfd-27d9e025f459 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:09.656768 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-58573dbd-a576-4fe4-8bfd-27d9e025f459 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:09.657211 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-58573dbd-a576-4fe4-8bfd-27d9e025f459 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:09.706675 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-abab68b5-aa3c-4010-98ea-bcc16ced5699 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:09.707286 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-abab68b5-aa3c-4010-98ea-bcc16ced5699 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:09.713437 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-abab68b5-aa3c-4010-98ea-bcc16ced5699 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:09.713886 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-abab68b5-aa3c-4010-98ea-bcc16ced5699 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:09.714679 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-abab68b5-aa3c-4010-98ea-bcc16ced5699 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:09.715113 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-abab68b5-aa3c-4010-98ea-bcc16ced5699 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:09.728136 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-58573dbd-a576-4fe4-8bfd-27d9e025f459 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:09.738738 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-58573dbd-a576-4fe4-8bfd-27d9e025f459 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1299 microversion: 2.1 time: 0.094497 Jun 26 03:05:09.739330 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 29/67] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:09 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:09.778331 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-41898f0c-0428-4ef7-8c91-b3aec7d9a049 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:09.779451 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-41898f0c-0428-4ef7-8c91-b3aec7d9a049 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:09.787429 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-41898f0c-0428-4ef7-8c91-b3aec7d9a049 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:09.788339 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-41898f0c-0428-4ef7-8c91-b3aec7d9a049 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:09.789127 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-41898f0c-0428-4ef7-8c91-b3aec7d9a049 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:09.789617 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-41898f0c-0428-4ef7-8c91-b3aec7d9a049 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:09.872765 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-41898f0c-0428-4ef7-8c91-b3aec7d9a049 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:09.880633 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-abab68b5-aa3c-4010-98ea-bcc16ced5699 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:09.883068 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-41898f0c-0428-4ef7-8c91-b3aec7d9a049 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.109989 Jun 26 03:05:09.890879 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 30/68] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:09 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:09.894405 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-abab68b5-aa3c-4010-98ea-bcc16ced5699 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:09.895858 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-abab68b5-aa3c-4010-98ea-bcc16ced5699 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:09.896957 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-abab68b5-aa3c-4010-98ea-bcc16ced5699 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.194163 Jun 26 03:05:09.897503 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 39/69] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:09 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:05:10.317341 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-404ec3be-55d2-4950-a492-fc58a92ed10e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:10.318030 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-404ec3be-55d2-4950-a492-fc58a92ed10e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:10.319943 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=8 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:10.325310 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-404ec3be-55d2-4950-a492-fc58a92ed10e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:10.325761 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-404ec3be-55d2-4950-a492-fc58a92ed10e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:10.327056 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-404ec3be-55d2-4950-a492-fc58a92ed10e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:10.327496 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-404ec3be-55d2-4950-a492-fc58a92ed10e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:10.463594 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-404ec3be-55d2-4950-a492-fc58a92ed10e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:10.472109 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-404ec3be-55d2-4950-a492-fc58a92ed10e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.158553 Jun 26 03:05:10.473349 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 31/70] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:10 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:10.484577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8dcfae38-29f3-45be-9f3d-a0b552902eb6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:10.485212 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8dcfae38-29f3-45be-9f3d-a0b552902eb6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:10.491221 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8dcfae38-29f3-45be-9f3d-a0b552902eb6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:10.491817 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8dcfae38-29f3-45be-9f3d-a0b552902eb6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:10.492579 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8dcfae38-29f3-45be-9f3d-a0b552902eb6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:10.493010 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8dcfae38-29f3-45be-9f3d-a0b552902eb6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:10.622736 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-8dcfae38-29f3-45be-9f3d-a0b552902eb6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:10.631513 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8dcfae38-29f3-45be-9f3d-a0b552902eb6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.151520 Jun 26 03:05:10.651665 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 40/71] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:10 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:10.757945 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-03c9e2c2-2d3f-413f-8270-92d89e82fb82 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:10.758629 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-03c9e2c2-2d3f-413f-8270-92d89e82fb82 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:10.760723 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=36 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:10.767085 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-03c9e2c2-2d3f-413f-8270-92d89e82fb82 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:10.767541 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-03c9e2c2-2d3f-413f-8270-92d89e82fb82 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:10.768344 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-03c9e2c2-2d3f-413f-8270-92d89e82fb82 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:10.768788 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-03c9e2c2-2d3f-413f-8270-92d89e82fb82 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:10.861283 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-03c9e2c2-2d3f-413f-8270-92d89e82fb82 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:10.871936 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-03c9e2c2-2d3f-413f-8270-92d89e82fb82 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1299 microversion: 2.1 time: 0.117926 Jun 26 03:05:10.872612 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 32/72] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:10 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:10.899965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-04529370-6b3d-459b-86bb-56243719ba8d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:10.900595 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-04529370-6b3d-459b-86bb-56243719ba8d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:10.912587 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-04529370-6b3d-459b-86bb-56243719ba8d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:10.913538 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-04529370-6b3d-459b-86bb-56243719ba8d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:10.914902 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-04529370-6b3d-459b-86bb-56243719ba8d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:10.916084 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-04529370-6b3d-459b-86bb-56243719ba8d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:10.916382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5f94a64b-3d5f-4889-8ac7-9f67752632ae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:10.917083 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5f94a64b-3d5f-4889-8ac7-9f67752632ae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:10.924149 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5f94a64b-3d5f-4889-8ac7-9f67752632ae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:10.924720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5f94a64b-3d5f-4889-8ac7-9f67752632ae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:10.925609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5f94a64b-3d5f-4889-8ac7-9f67752632ae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:10.926256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5f94a64b-3d5f-4889-8ac7-9f67752632ae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:11.011090 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-04529370-6b3d-459b-86bb-56243719ba8d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:11.019152 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-04529370-6b3d-459b-86bb-56243719ba8d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.123032 Jun 26 03:05:11.029536 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 41/73] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:10 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:11.122514 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5f94a64b-3d5f-4889-8ac7-9f67752632ae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:11.133292 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5f94a64b-3d5f-4889-8ac7-9f67752632ae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:11.135165 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5f94a64b-3d5f-4889-8ac7-9f67752632ae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:11.136822 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5f94a64b-3d5f-4889-8ac7-9f67752632ae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.224964 Jun 26 03:05:11.138250 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 33/74] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:10 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:11.489236 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8e9204b3-d6a3-40e0-9eef-d5e0ec20bb0d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:11.490390 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8e9204b3-d6a3-40e0-9eef-d5e0ec20bb0d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:11.496083 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8e9204b3-d6a3-40e0-9eef-d5e0ec20bb0d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:11.496531 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8e9204b3-d6a3-40e0-9eef-d5e0ec20bb0d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:11.497286 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8e9204b3-d6a3-40e0-9eef-d5e0ec20bb0d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:11.497720 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8e9204b3-d6a3-40e0-9eef-d5e0ec20bb0d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:11.636932 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-8e9204b3-d6a3-40e0-9eef-d5e0ec20bb0d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:11.648524 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8e9204b3-d6a3-40e0-9eef-d5e0ec20bb0d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.162961 Jun 26 03:05:11.649341 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 42/75] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:11 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:11.659489 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-13dda061-e2f9-4685-a367-c9b9ee69d2f4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:11.660114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-13dda061-e2f9-4685-a367-c9b9ee69d2f4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:11.667315 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-13dda061-e2f9-4685-a367-c9b9ee69d2f4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:11.667962 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-13dda061-e2f9-4685-a367-c9b9ee69d2f4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:11.668848 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-13dda061-e2f9-4685-a367-c9b9ee69d2f4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:11.669285 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-13dda061-e2f9-4685-a367-c9b9ee69d2f4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:11.821297 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-13dda061-e2f9-4685-a367-c9b9ee69d2f4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:11.829453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-13dda061-e2f9-4685-a367-c9b9ee69d2f4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.173853 Jun 26 03:05:11.830026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 34/76] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:11 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:11.888631 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-208cbaee-f613-4221-a3d9-05c6215f3b66 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:11.889811 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-208cbaee-f613-4221-a3d9-05c6215f3b66 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:11.896454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-208cbaee-f613-4221-a3d9-05c6215f3b66 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:11.897023 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-208cbaee-f613-4221-a3d9-05c6215f3b66 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:11.897862 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-208cbaee-f613-4221-a3d9-05c6215f3b66 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:11.898332 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-208cbaee-f613-4221-a3d9-05c6215f3b66 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:11.961005 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-208cbaee-f613-4221-a3d9-05c6215f3b66 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:11.970587 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-208cbaee-f613-4221-a3d9-05c6215f3b66 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1299 microversion: 2.1 time: 0.085705 Jun 26 03:05:11.971166 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 43/77] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:11 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:12.037926 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c80c3561-53e3-42bf-ae87-a48f8bf31c87 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:12.038780 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c80c3561-53e3-42bf-ae87-a48f8bf31c87 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:12.045829 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c80c3561-53e3-42bf-ae87-a48f8bf31c87 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:12.046367 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c80c3561-53e3-42bf-ae87-a48f8bf31c87 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:12.047250 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c80c3561-53e3-42bf-ae87-a48f8bf31c87 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:12.047759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c80c3561-53e3-42bf-ae87-a48f8bf31c87 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:12.118588 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c80c3561-53e3-42bf-ae87-a48f8bf31c87 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:12.127153 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c80c3561-53e3-42bf-ae87-a48f8bf31c87 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.094373 Jun 26 03:05:12.128339 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 35/78] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:12 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:12.155823 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b25fb925-8d1a-4865-a7e8-728d2a267c7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:12.156430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b25fb925-8d1a-4865-a7e8-728d2a267c7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:12.162566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b25fb925-8d1a-4865-a7e8-728d2a267c7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:12.163011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b25fb925-8d1a-4865-a7e8-728d2a267c7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:12.163756 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b25fb925-8d1a-4865-a7e8-728d2a267c7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:12.164187 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b25fb925-8d1a-4865-a7e8-728d2a267c7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:12.313393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b25fb925-8d1a-4865-a7e8-728d2a267c7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:12.321553 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b25fb925-8d1a-4865-a7e8-728d2a267c7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:12.323093 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b25fb925-8d1a-4865-a7e8-728d2a267c7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:12.324198 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b25fb925-8d1a-4865-a7e8-728d2a267c7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.172855 Jun 26 03:05:12.324899 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 44/79] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:12 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:12.666740 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2794737c-b4f9-42fa-85b4-85e6df18386f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:12.667460 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2794737c-b4f9-42fa-85b4-85e6df18386f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:12.686405 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2794737c-b4f9-42fa-85b4-85e6df18386f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:12.686845 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2794737c-b4f9-42fa-85b4-85e6df18386f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:12.687636 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2794737c-b4f9-42fa-85b4-85e6df18386f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:12.688082 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2794737c-b4f9-42fa-85b4-85e6df18386f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:12.820355 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2794737c-b4f9-42fa-85b4-85e6df18386f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:12.827976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2794737c-b4f9-42fa-85b4-85e6df18386f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.165394 Jun 26 03:05:12.830335 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 36/80] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:12 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:12.845882 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b2fbcbf1-b784-40d1-a286-da6aaa247082 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:12.846561 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b2fbcbf1-b784-40d1-a286-da6aaa247082 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:12.852725 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b2fbcbf1-b784-40d1-a286-da6aaa247082 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:12.853196 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b2fbcbf1-b784-40d1-a286-da6aaa247082 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:12.854090 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b2fbcbf1-b784-40d1-a286-da6aaa247082 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:12.854528 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b2fbcbf1-b784-40d1-a286-da6aaa247082 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:12.989500 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-56944001-3661-4a30-8410-47221bd0f8d4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:12.990240 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-56944001-3661-4a30-8410-47221bd0f8d4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:12.997069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-56944001-3661-4a30-8410-47221bd0f8d4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:12.997516 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-56944001-3661-4a30-8410-47221bd0f8d4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:12.999089 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-56944001-3661-4a30-8410-47221bd0f8d4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:12.999715 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-56944001-3661-4a30-8410-47221bd0f8d4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:13.006486 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b2fbcbf1-b784-40d1-a286-da6aaa247082 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:13.015106 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b2fbcbf1-b784-40d1-a286-da6aaa247082 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.173521 Jun 26 03:05:13.025353 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 45/81] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:12 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:13.084037 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-56944001-3661-4a30-8410-47221bd0f8d4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:13.097355 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-56944001-3661-4a30-8410-47221bd0f8d4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1299 microversion: 2.1 time: 0.112278 Jun 26 03:05:13.101384 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 37/82] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:12 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:13.144346 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a5ee2f04-9143-4403-8f64-0b38eeb6a2ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:13.144954 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a5ee2f04-9143-4403-8f64-0b38eeb6a2ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:13.151056 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a5ee2f04-9143-4403-8f64-0b38eeb6a2ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:13.151459 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a5ee2f04-9143-4403-8f64-0b38eeb6a2ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:13.152224 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a5ee2f04-9143-4403-8f64-0b38eeb6a2ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:13.152663 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a5ee2f04-9143-4403-8f64-0b38eeb6a2ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:13.220482 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a5ee2f04-9143-4403-8f64-0b38eeb6a2ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:13.228415 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a5ee2f04-9143-4403-8f64-0b38eeb6a2ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.087831 Jun 26 03:05:13.229092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 46/83] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:13 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:13.343465 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d6e13956-1367-4979-bf9b-d8d83dcb8e4a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:13.344209 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d6e13956-1367-4979-bf9b-d8d83dcb8e4a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:13.350722 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d6e13956-1367-4979-bf9b-d8d83dcb8e4a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:13.351575 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d6e13956-1367-4979-bf9b-d8d83dcb8e4a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:13.363857 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d6e13956-1367-4979-bf9b-d8d83dcb8e4a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:13.364318 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d6e13956-1367-4979-bf9b-d8d83dcb8e4a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:13.501164 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d6e13956-1367-4979-bf9b-d8d83dcb8e4a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:13.509305 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d6e13956-1367-4979-bf9b-d8d83dcb8e4a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:13.510828 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d6e13956-1367-4979-bf9b-d8d83dcb8e4a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:13.511965 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d6e13956-1367-4979-bf9b-d8d83dcb8e4a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.173334 Jun 26 03:05:13.512515 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 38/84] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:13 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:13.845354 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c3a77dd6-d24b-48c5-b04c-fa0a4d3690c1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:13.846541 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c3a77dd6-d24b-48c5-b04c-fa0a4d3690c1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:13.854917 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c3a77dd6-d24b-48c5-b04c-fa0a4d3690c1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:13.855368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c3a77dd6-d24b-48c5-b04c-fa0a4d3690c1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:13.856177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c3a77dd6-d24b-48c5-b04c-fa0a4d3690c1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:13.856609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c3a77dd6-d24b-48c5-b04c-fa0a4d3690c1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:13.876077 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=100 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:13.992289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c3a77dd6-d24b-48c5-b04c-fa0a4d3690c1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:14.000452 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c3a77dd6-d24b-48c5-b04c-fa0a4d3690c1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.159488 Jun 26 03:05:14.001195 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 47/85] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:13 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:14.032514 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-0fe37ad6-03b9-47bb-aa7c-c0922c51d204 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:14.033126 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-0fe37ad6-03b9-47bb-aa7c-c0922c51d204 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:14.039125 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0fe37ad6-03b9-47bb-aa7c-c0922c51d204 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:14.039574 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0fe37ad6-03b9-47bb-aa7c-c0922c51d204 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:14.040362 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0fe37ad6-03b9-47bb-aa7c-c0922c51d204 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:14.040797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0fe37ad6-03b9-47bb-aa7c-c0922c51d204 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:14.117987 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2cef82aa-ae64-474e-b2a3-c50502fd76ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:14.118512 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2cef82aa-ae64-474e-b2a3-c50502fd76ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:14.126617 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2cef82aa-ae64-474e-b2a3-c50502fd76ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:14.127344 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2cef82aa-ae64-474e-b2a3-c50502fd76ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:14.128629 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2cef82aa-ae64-474e-b2a3-c50502fd76ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:14.129210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2cef82aa-ae64-474e-b2a3-c50502fd76ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:14.191553 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-0fe37ad6-03b9-47bb-aa7c-c0922c51d204 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:14.199861 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-0fe37ad6-03b9-47bb-aa7c-c0922c51d204 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.171709 Jun 26 03:05:14.210456 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 39/86] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:14 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:14.214700 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-2cef82aa-ae64-474e-b2a3-c50502fd76ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:14.223249 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2cef82aa-ae64-474e-b2a3-c50502fd76ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1299 microversion: 2.1 time: 0.109125 Jun 26 03:05:14.224029 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 48/87] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:14 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:14.248902 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d8612133-e9cc-48d9-a394-d63e6c2c18e1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:14.249518 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d8612133-e9cc-48d9-a394-d63e6c2c18e1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:14.256462 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d8612133-e9cc-48d9-a394-d63e6c2c18e1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:14.256917 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d8612133-e9cc-48d9-a394-d63e6c2c18e1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:14.257691 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d8612133-e9cc-48d9-a394-d63e6c2c18e1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:14.258162 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d8612133-e9cc-48d9-a394-d63e6c2c18e1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:14.323014 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d8612133-e9cc-48d9-a394-d63e6c2c18e1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:14.331099 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d8612133-e9cc-48d9-a394-d63e6c2c18e1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.090425 Jun 26 03:05:14.331676 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 40/88] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:14 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:14.529903 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-cac412c0-53b6-423c-99bb-f1d94b967828 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:14.530571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-cac412c0-53b6-423c-99bb-f1d94b967828 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:14.536555 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cac412c0-53b6-423c-99bb-f1d94b967828 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:14.537011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cac412c0-53b6-423c-99bb-f1d94b967828 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:14.537776 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cac412c0-53b6-423c-99bb-f1d94b967828 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:14.538279 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cac412c0-53b6-423c-99bb-f1d94b967828 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:14.661442 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-cac412c0-53b6-423c-99bb-f1d94b967828 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:14.669773 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-cac412c0-53b6-423c-99bb-f1d94b967828 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:14.671836 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-cac412c0-53b6-423c-99bb-f1d94b967828 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:14.672964 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-cac412c0-53b6-423c-99bb-f1d94b967828 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.146965 Jun 26 03:05:14.673527 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 49/89] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:14 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:15.016754 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fe3a68da-9772-487e-a6fa-dfbd72aae4ed tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:15.017287 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-fe3a68da-9772-487e-a6fa-dfbd72aae4ed tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:15.023298 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fe3a68da-9772-487e-a6fa-dfbd72aae4ed tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:15.023749 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fe3a68da-9772-487e-a6fa-dfbd72aae4ed tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:15.024503 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fe3a68da-9772-487e-a6fa-dfbd72aae4ed tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:15.024939 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fe3a68da-9772-487e-a6fa-dfbd72aae4ed tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:15.172651 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-fe3a68da-9772-487e-a6fa-dfbd72aae4ed tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:15.180122 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-fe3a68da-9772-487e-a6fa-dfbd72aae4ed tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.167274 Jun 26 03:05:15.180692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 41/90] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:15 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:15.216819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-167ee950-e1b4-48c3-8ea9-36e649b3de48 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:15.218641 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-167ee950-e1b4-48c3-8ea9-36e649b3de48 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:15.224693 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-167ee950-e1b4-48c3-8ea9-36e649b3de48 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:15.225139 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-167ee950-e1b4-48c3-8ea9-36e649b3de48 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:15.225967 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-167ee950-e1b4-48c3-8ea9-36e649b3de48 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:15.226434 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-167ee950-e1b4-48c3-8ea9-36e649b3de48 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:15.239681 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-338f44f8-0bd2-413d-a56a-e8beaca40863 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:15.240380 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-338f44f8-0bd2-413d-a56a-e8beaca40863 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:15.247497 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-338f44f8-0bd2-413d-a56a-e8beaca40863 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:15.247497 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-338f44f8-0bd2-413d-a56a-e8beaca40863 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:15.247724 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-338f44f8-0bd2-413d-a56a-e8beaca40863 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:15.248071 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-338f44f8-0bd2-413d-a56a-e8beaca40863 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:15.328848 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-338f44f8-0bd2-413d-a56a-e8beaca40863 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:15.336575 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-338f44f8-0bd2-413d-a56a-e8beaca40863 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1299 microversion: 2.1 time: 0.100585 Jun 26 03:05:15.337226 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 42/91] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:15 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:15.347848 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-eb0318a0-0225-4680-9715-a9cbd27e160d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:15.348453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-eb0318a0-0225-4680-9715-a9cbd27e160d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:15.354943 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eb0318a0-0225-4680-9715-a9cbd27e160d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:15.355519 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eb0318a0-0225-4680-9715-a9cbd27e160d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:15.356294 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eb0318a0-0225-4680-9715-a9cbd27e160d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:15.356727 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eb0318a0-0225-4680-9715-a9cbd27e160d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:15.417236 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-167ee950-e1b4-48c3-8ea9-36e649b3de48 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:15.430796 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-167ee950-e1b4-48c3-8ea9-36e649b3de48 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.217875 Jun 26 03:05:15.431902 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 50/92] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:15 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:15.437841 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-eb0318a0-0225-4680-9715-a9cbd27e160d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:15.445474 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-eb0318a0-0225-4680-9715-a9cbd27e160d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.101169 Jun 26 03:05:15.446259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 43/93] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:15 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:15.691567 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9520fa3e-5b7b-4d6d-85f2-5482d8376320 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:15.692437 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9520fa3e-5b7b-4d6d-85f2-5482d8376320 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:15.700636 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9520fa3e-5b7b-4d6d-85f2-5482d8376320 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:15.701351 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9520fa3e-5b7b-4d6d-85f2-5482d8376320 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:15.702547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9520fa3e-5b7b-4d6d-85f2-5482d8376320 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:15.703285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9520fa3e-5b7b-4d6d-85f2-5482d8376320 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:15.841061 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9520fa3e-5b7b-4d6d-85f2-5482d8376320 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:15.856425 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9520fa3e-5b7b-4d6d-85f2-5482d8376320 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:15.858523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9520fa3e-5b7b-4d6d-85f2-5482d8376320 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:15.859725 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9520fa3e-5b7b-4d6d-85f2-5482d8376320 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.171999 Jun 26 03:05:15.870621 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 51/94] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:15 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:16.197192 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-0c66e4b7-71e8-4dab-a065-6f1a76931eab tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:16.198103 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-0c66e4b7-71e8-4dab-a065-6f1a76931eab tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:16.205573 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0c66e4b7-71e8-4dab-a065-6f1a76931eab tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:16.206017 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0c66e4b7-71e8-4dab-a065-6f1a76931eab tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:16.206805 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0c66e4b7-71e8-4dab-a065-6f1a76931eab tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:16.207237 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0c66e4b7-71e8-4dab-a065-6f1a76931eab tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:16.354780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fba1727f-9372-40b1-a1aa-baea4802b2fb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:16.355385 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fba1727f-9372-40b1-a1aa-baea4802b2fb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:16.363708 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fba1727f-9372-40b1-a1aa-baea4802b2fb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:16.364152 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fba1727f-9372-40b1-a1aa-baea4802b2fb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:16.364924 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fba1727f-9372-40b1-a1aa-baea4802b2fb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:16.365357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fba1727f-9372-40b1-a1aa-baea4802b2fb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:16.389420 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-0c66e4b7-71e8-4dab-a065-6f1a76931eab tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:16.392805 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=100 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:16.398446 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-0c66e4b7-71e8-4dab-a065-6f1a76931eab tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.205333 Jun 26 03:05:16.399023 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 44/95] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:16 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:16.432482 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fba1727f-9372-40b1-a1aa-baea4802b2fb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:16.439773 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fba1727f-9372-40b1-a1aa-baea4802b2fb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1299 microversion: 2.1 time: 0.089189 Jun 26 03:05:16.440330 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 52/96] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:16 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:16.447559 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-abf5b87b-e762-47fa-a6c9-98f3dddc1307 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:16.448104 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-abf5b87b-e762-47fa-a6c9-98f3dddc1307 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:16.454868 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-abf5b87b-e762-47fa-a6c9-98f3dddc1307 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:16.455311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-abf5b87b-e762-47fa-a6c9-98f3dddc1307 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:16.456063 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-abf5b87b-e762-47fa-a6c9-98f3dddc1307 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:16.456495 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-abf5b87b-e762-47fa-a6c9-98f3dddc1307 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:16.462295 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6c5d393d-9646-469e-b411-dae1262e31cd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:16.462914 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-6c5d393d-9646-469e-b411-dae1262e31cd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:16.469558 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6c5d393d-9646-469e-b411-dae1262e31cd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:16.470013 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6c5d393d-9646-469e-b411-dae1262e31cd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:16.470813 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6c5d393d-9646-469e-b411-dae1262e31cd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:16.471257 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6c5d393d-9646-469e-b411-dae1262e31cd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:16.554947 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6c5d393d-9646-469e-b411-dae1262e31cd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:16.566808 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6c5d393d-9646-469e-b411-dae1262e31cd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.107980 Jun 26 03:05:16.574881 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 53/97] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:16 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:16.648276 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-abf5b87b-e762-47fa-a6c9-98f3dddc1307 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:16.660142 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-abf5b87b-e762-47fa-a6c9-98f3dddc1307 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.213027 Jun 26 03:05:16.660142 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 45/98] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:16 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:16.877295 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-608c2553-fdb3-4a43-b395-ae894c478194 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:16.878185 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-608c2553-fdb3-4a43-b395-ae894c478194 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:16.884208 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-608c2553-fdb3-4a43-b395-ae894c478194 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:16.884656 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-608c2553-fdb3-4a43-b395-ae894c478194 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:16.885407 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-608c2553-fdb3-4a43-b395-ae894c478194 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:16.885845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-608c2553-fdb3-4a43-b395-ae894c478194 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:17.023126 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-608c2553-fdb3-4a43-b395-ae894c478194 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:17.031663 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-608c2553-fdb3-4a43-b395-ae894c478194 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:17.033190 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-608c2553-fdb3-4a43-b395-ae894c478194 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:17.034358 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-608c2553-fdb3-4a43-b395-ae894c478194 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.161510 Jun 26 03:05:17.034930 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 54/99] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:16 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:17.415606 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-547cf235-8664-4e45-a009-bb63970277f7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:17.416217 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-547cf235-8664-4e45-a009-bb63970277f7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:17.422415 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-547cf235-8664-4e45-a009-bb63970277f7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:17.422871 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-547cf235-8664-4e45-a009-bb63970277f7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:17.423637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-547cf235-8664-4e45-a009-bb63970277f7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:17.424073 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-547cf235-8664-4e45-a009-bb63970277f7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:17.457514 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d84f90fd-d012-4731-b813-863b28e5f0f5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:17.458820 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d84f90fd-d012-4731-b813-863b28e5f0f5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:17.465440 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d84f90fd-d012-4731-b813-863b28e5f0f5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:17.466013 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d84f90fd-d012-4731-b813-863b28e5f0f5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:17.466810 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d84f90fd-d012-4731-b813-863b28e5f0f5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:17.467448 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d84f90fd-d012-4731-b813-863b28e5f0f5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:17.542727 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d84f90fd-d012-4731-b813-863b28e5f0f5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:17.552230 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d84f90fd-d012-4731-b813-863b28e5f0f5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1299 microversion: 2.1 time: 0.098711 Jun 26 03:05:17.552970 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 55/100] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:17 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:17.583299 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0c1c3da1-a702-40ee-8eb2-6106bf49a8a6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:17.584019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0c1c3da1-a702-40ee-8eb2-6106bf49a8a6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:17.588952 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-547cf235-8664-4e45-a009-bb63970277f7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:17.590155 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0c1c3da1-a702-40ee-8eb2-6106bf49a8a6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:17.590672 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0c1c3da1-a702-40ee-8eb2-6106bf49a8a6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:17.591497 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0c1c3da1-a702-40ee-8eb2-6106bf49a8a6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:17.592374 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0c1c3da1-a702-40ee-8eb2-6106bf49a8a6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:17.597060 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-547cf235-8664-4e45-a009-bb63970277f7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.185248 Jun 26 03:05:17.597630 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 46/101] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:17 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:17.653613 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0c1c3da1-a702-40ee-8eb2-6106bf49a8a6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:17.662663 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0c1c3da1-a702-40ee-8eb2-6106bf49a8a6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.082995 Jun 26 03:05:17.663447 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 56/102] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:17 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:17.675648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1d9449be-bbf6-41a2-9733-1e35002a36ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:17.676264 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1d9449be-bbf6-41a2-9733-1e35002a36ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:17.682530 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1d9449be-bbf6-41a2-9733-1e35002a36ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:17.682990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1d9449be-bbf6-41a2-9733-1e35002a36ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:17.683769 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1d9449be-bbf6-41a2-9733-1e35002a36ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:17.684211 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1d9449be-bbf6-41a2-9733-1e35002a36ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:17.808477 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1d9449be-bbf6-41a2-9733-1e35002a36ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:17.816176 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1d9449be-bbf6-41a2-9733-1e35002a36ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.145818 Jun 26 03:05:17.816752 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 47/103] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:17 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:18.055448 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3a093f4e-c001-46c1-be45-4a4d011e4240 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:18.055981 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3a093f4e-c001-46c1-be45-4a4d011e4240 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:18.063260 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a093f4e-c001-46c1-be45-4a4d011e4240 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:18.063900 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a093f4e-c001-46c1-be45-4a4d011e4240 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:18.064972 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a093f4e-c001-46c1-be45-4a4d011e4240 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:18.065411 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a093f4e-c001-46c1-be45-4a4d011e4240 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:18.193888 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3a093f4e-c001-46c1-be45-4a4d011e4240 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:18.201655 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3a093f4e-c001-46c1-be45-4a4d011e4240 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:18.203741 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3a093f4e-c001-46c1-be45-4a4d011e4240 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:18.204821 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3a093f4e-c001-46c1-be45-4a4d011e4240 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.153486 Jun 26 03:05:18.205368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 57/104] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:18 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:18.568469 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-472d5e88-7b25-4ab5-8efb-05e18aea8b20 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:18.569162 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-472d5e88-7b25-4ab5-8efb-05e18aea8b20 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:18.575305 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-472d5e88-7b25-4ab5-8efb-05e18aea8b20 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:18.575611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-472d5e88-7b25-4ab5-8efb-05e18aea8b20 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:18.576381 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-472d5e88-7b25-4ab5-8efb-05e18aea8b20 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:18.576821 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-472d5e88-7b25-4ab5-8efb-05e18aea8b20 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:18.613624 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e569b353-e86d-433e-9ea7-cd9dd08fc294 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:18.614343 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e569b353-e86d-433e-9ea7-cd9dd08fc294 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:18.620674 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e569b353-e86d-433e-9ea7-cd9dd08fc294 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:18.621134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e569b353-e86d-433e-9ea7-cd9dd08fc294 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:18.621903 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e569b353-e86d-433e-9ea7-cd9dd08fc294 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:18.622375 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e569b353-e86d-433e-9ea7-cd9dd08fc294 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:18.642059 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-472d5e88-7b25-4ab5-8efb-05e18aea8b20 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:18.649764 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-472d5e88-7b25-4ab5-8efb-05e18aea8b20 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1299 microversion: 2.1 time: 0.085047 Jun 26 03:05:18.650378 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 48/105] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:18 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:18.679410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-44e17b59-354d-4dcc-bd2c-212fbfa67335 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:18.680020 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-44e17b59-354d-4dcc-bd2c-212fbfa67335 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:18.686006 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-44e17b59-354d-4dcc-bd2c-212fbfa67335 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:18.686493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-44e17b59-354d-4dcc-bd2c-212fbfa67335 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:18.687289 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-44e17b59-354d-4dcc-bd2c-212fbfa67335 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:18.687731 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-44e17b59-354d-4dcc-bd2c-212fbfa67335 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:18.755389 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-44e17b59-354d-4dcc-bd2c-212fbfa67335 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:18.762970 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-44e17b59-354d-4dcc-bd2c-212fbfa67335 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.087396 Jun 26 03:05:18.763730 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 49/106] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:18 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:18.777761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e569b353-e86d-433e-9ea7-cd9dd08fc294 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:18.785033 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e569b353-e86d-433e-9ea7-cd9dd08fc294 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.175279 Jun 26 03:05:18.785587 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 58/107] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:18 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:18.833146 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d4d136b7-8135-4f86-992c-2db4aa7c7fd0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:18.833685 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d4d136b7-8135-4f86-992c-2db4aa7c7fd0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:18.839703 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4d136b7-8135-4f86-992c-2db4aa7c7fd0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:18.840149 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4d136b7-8135-4f86-992c-2db4aa7c7fd0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:18.840894 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4d136b7-8135-4f86-992c-2db4aa7c7fd0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:18.841325 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4d136b7-8135-4f86-992c-2db4aa7c7fd0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:18.969252 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d4d136b7-8135-4f86-992c-2db4aa7c7fd0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:18.976618 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d4d136b7-8135-4f86-992c-2db4aa7c7fd0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.147301 Jun 26 03:05:18.977184 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 50/108] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:18 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:19.222633 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d2c3faa0-1866-47e3-9d8c-f107ae4e6400 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:19.223245 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d2c3faa0-1866-47e3-9d8c-f107ae4e6400 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:19.229284 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d2c3faa0-1866-47e3-9d8c-f107ae4e6400 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:19.229737 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d2c3faa0-1866-47e3-9d8c-f107ae4e6400 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:19.230520 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d2c3faa0-1866-47e3-9d8c-f107ae4e6400 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:19.230960 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d2c3faa0-1866-47e3-9d8c-f107ae4e6400 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:19.353387 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d2c3faa0-1866-47e3-9d8c-f107ae4e6400 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:19.361640 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d2c3faa0-1866-47e3-9d8c-f107ae4e6400 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:19.363174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d2c3faa0-1866-47e3-9d8c-f107ae4e6400 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:19.364269 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d2c3faa0-1866-47e3-9d8c-f107ae4e6400 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.145660 Jun 26 03:05:19.364821 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 59/109] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:19 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:19.669752 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6d8a5db0-d088-462a-9abd-fc4e481c026f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:19.671054 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-6d8a5db0-d088-462a-9abd-fc4e481c026f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:19.678801 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6d8a5db0-d088-462a-9abd-fc4e481c026f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:19.679244 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6d8a5db0-d088-462a-9abd-fc4e481c026f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:19.680173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6d8a5db0-d088-462a-9abd-fc4e481c026f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:19.680718 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6d8a5db0-d088-462a-9abd-fc4e481c026f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:19.761563 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-6d8a5db0-d088-462a-9abd-fc4e481c026f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:19.769829 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6d8a5db0-d088-462a-9abd-fc4e481c026f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1299 microversion: 2.1 time: 0.106217 Jun 26 03:05:19.770701 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 51/110] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:19 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:19.785127 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e5656934-45f3-4892-8e9d-7f42646087af tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:19.786002 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e5656934-45f3-4892-8e9d-7f42646087af tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:19.793304 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e5656934-45f3-4892-8e9d-7f42646087af tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:19.793957 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e5656934-45f3-4892-8e9d-7f42646087af tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:19.795828 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e5656934-45f3-4892-8e9d-7f42646087af tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:19.795828 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e5656934-45f3-4892-8e9d-7f42646087af tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:19.801268 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b35e96e3-1dbc-4137-b266-6d3f51cc97a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:19.801896 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b35e96e3-1dbc-4137-b266-6d3f51cc97a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:19.813934 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b35e96e3-1dbc-4137-b266-6d3f51cc97a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:19.814412 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b35e96e3-1dbc-4137-b266-6d3f51cc97a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:19.815180 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b35e96e3-1dbc-4137-b266-6d3f51cc97a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:19.815614 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b35e96e3-1dbc-4137-b266-6d3f51cc97a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:19.985632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e5656934-45f3-4892-8e9d-7f42646087af tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:19.993336 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e5656934-45f3-4892-8e9d-7f42646087af tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1279 microversion: 2.1 time: 0.212460 Jun 26 03:05:19.994019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 60/111] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:19 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:20.001492 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-abff9589-3b58-4aad-948e-1a3893fb964a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:20.002592 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-abff9589-3b58-4aad-948e-1a3893fb964a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:20.009593 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-abff9589-3b58-4aad-948e-1a3893fb964a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:20.010089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-abff9589-3b58-4aad-948e-1a3893fb964a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:20.010962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-abff9589-3b58-4aad-948e-1a3893fb964a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:20.011406 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-abff9589-3b58-4aad-948e-1a3893fb964a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:20.475538 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b35e96e3-1dbc-4137-b266-6d3f51cc97a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:20.485102 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b35e96e3-1dbc-4137-b266-6d3f51cc97a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.687655 Jun 26 03:05:20.496206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 52/112] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:19 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:20.501609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d5961dff-c091-414f-add9-9ca877871de5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:20.502363 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d5961dff-c091-414f-add9-9ca877871de5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:20.509114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d5961dff-c091-414f-add9-9ca877871de5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:20.509881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d5961dff-c091-414f-add9-9ca877871de5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:20.510889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d5961dff-c091-414f-add9-9ca877871de5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:20.511572 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d5961dff-c091-414f-add9-9ca877871de5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:20.616293 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-abff9589-3b58-4aad-948e-1a3893fb964a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:20.629044 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-abff9589-3b58-4aad-948e-1a3893fb964a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.633881 Jun 26 03:05:20.631132 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 61/113] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:19 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:20.788818 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9635a2b8-a3ce-4ba3-9dbd-dd3c7ffcf122 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:20.790251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9635a2b8-a3ce-4ba3-9dbd-dd3c7ffcf122 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:20.803808 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9635a2b8-a3ce-4ba3-9dbd-dd3c7ffcf122 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:20.804628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9635a2b8-a3ce-4ba3-9dbd-dd3c7ffcf122 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:20.805562 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9635a2b8-a3ce-4ba3-9dbd-dd3c7ffcf122 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:20.806173 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9635a2b8-a3ce-4ba3-9dbd-dd3c7ffcf122 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:21.090899 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9635a2b8-a3ce-4ba3-9dbd-dd3c7ffcf122 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:21.104979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9635a2b8-a3ce-4ba3-9dbd-dd3c7ffcf122 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1299 microversion: 2.1 time: 0.320370 Jun 26 03:05:21.106552 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 62/114] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:20 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1299 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:21.121314 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ac2d4cbb-8f58-4b7f-8b4d-2283954a3d3c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:21.122275 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ac2d4cbb-8f58-4b7f-8b4d-2283954a3d3c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:21.141790 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac2d4cbb-8f58-4b7f-8b4d-2283954a3d3c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:21.145482 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac2d4cbb-8f58-4b7f-8b4d-2283954a3d3c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:21.149619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac2d4cbb-8f58-4b7f-8b4d-2283954a3d3c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:21.150333 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac2d4cbb-8f58-4b7f-8b4d-2283954a3d3c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:21.504331 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d5961dff-c091-414f-add9-9ca877871de5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:21.517926 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d5961dff-c091-414f-add9-9ca877871de5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:21.521899 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d5961dff-c091-414f-add9-9ca877871de5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:21.523376 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d5961dff-c091-414f-add9-9ca877871de5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 1.025833 Jun 26 03:05:21.524475 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 53/115] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:20 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:21.532505 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3facf590-814d-4c73-8680-c330ba229edd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:21.533393 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3facf590-814d-4c73-8680-c330ba229edd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:21.542096 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3facf590-814d-4c73-8680-c330ba229edd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:21.542885 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3facf590-814d-4c73-8680-c330ba229edd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:21.543865 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3facf590-814d-4c73-8680-c330ba229edd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:21.545013 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3facf590-814d-4c73-8680-c330ba229edd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:21.928820 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ac2d4cbb-8f58-4b7f-8b4d-2283954a3d3c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:21.951187 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ac2d4cbb-8f58-4b7f-8b4d-2283954a3d3c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.843110 Jun 26 03:05:21.960113 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 63/116] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:21 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:21.964651 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f9cba64f-7fb9-4240-9b52-f152f71f2201 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:21.965865 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f9cba64f-7fb9-4240-9b52-f152f71f2201 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:21.980485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9cba64f-7fb9-4240-9b52-f152f71f2201 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:21.980943 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9cba64f-7fb9-4240-9b52-f152f71f2201 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:21.983218 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9cba64f-7fb9-4240-9b52-f152f71f2201 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:21.983684 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9cba64f-7fb9-4240-9b52-f152f71f2201 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:21.997843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=100 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:23.010763 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-3facf590-814d-4c73-8680-c330ba229edd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:23.035665 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3facf590-814d-4c73-8680-c330ba229edd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 1.509871 Jun 26 03:05:23.036257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 54/117] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:21 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:23.114247 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f9cba64f-7fb9-4240-9b52-f152f71f2201 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:23.142013 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f9cba64f-7fb9-4240-9b52-f152f71f2201 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 1.182400 Jun 26 03:05:23.147498 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 64/118] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:21 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:23.182002 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8ce3fbdf-348b-4280-a9f9-27bbc5585a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:23.191654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8ce3fbdf-348b-4280-a9f9-27bbc5585a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:23.203538 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8ce3fbdf-348b-4280-a9f9-27bbc5585a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:23.204249 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8ce3fbdf-348b-4280-a9f9-27bbc5585a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:23.205449 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8ce3fbdf-348b-4280-a9f9-27bbc5585a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:23.206128 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8ce3fbdf-348b-4280-a9f9-27bbc5585a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:23.241681 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-d6416e49-a618-4652-ab93-dd27baf54c88 req-7f691935-69d4-4dbb-9381-b1909fc3b298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cddc852a-2aa2-4a44-ad1a-e9e930e3bddf", "tag": "634b866a-e4dd-43d0-84a2-3a0a964abbff"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:23.271320 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-d6416e49-a618-4652-ab93-dd27baf54c88 req-7f691935-69d4-4dbb-9381-b1909fc3b298 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:23.271795 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-d6416e49-a618-4652-ab93-dd27baf54c88 req-7f691935-69d4-4dbb-9381-b1909fc3b298 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:23.334323 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-d6416e49-a618-4652-ab93-dd27baf54c88 req-7f691935-69d4-4dbb-9381-b1909fc3b298 service nova] Creating event network-changed:634b866a-e4dd-43d0-84a2-3a0a964abbff for instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf on hv-cinder-84684 Jun 26 03:05:23.334872 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-d6416e49-a618-4652-ab93-dd27baf54c88 req-7f691935-69d4-4dbb-9381-b1909fc3b298 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117782) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 26 03:05:23.336007 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-708a646e-9277-44d3-afbd-bf2b1f259da5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:23.341074 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-708a646e-9277-44d3-afbd-bf2b1f259da5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:23.342398 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-708a646e-9277-44d3-afbd-bf2b1f259da5 None None] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:23.343164 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-708a646e-9277-44d3-afbd-bf2b1f259da5 None None] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:23.359952 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.compute.rpcapi [None req-708a646e-9277-44d3-afbd-bf2b1f259da5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 26 03:05:23.361375 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-708a646e-9277-44d3-afbd-bf2b1f259da5 None None] Releasing lock "compute-rpcapi-router" {{(pid=117782) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 26 03:05:23.396287 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-708a646e-9277-44d3-afbd-bf2b1f259da5 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.357489 Jun 26 03:05:23.397455 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 55/119] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:05:23.409158 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-aa5ebf47-38ae-4e20-a139-64091a18e886 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:23.410635 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-aa5ebf47-38ae-4e20-a139-64091a18e886 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:23.421497 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aa5ebf47-38ae-4e20-a139-64091a18e886 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:23.422566 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aa5ebf47-38ae-4e20-a139-64091a18e886 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:23.423618 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aa5ebf47-38ae-4e20-a139-64091a18e886 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:23.431074 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aa5ebf47-38ae-4e20-a139-64091a18e886 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:23.895834 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-8ce3fbdf-348b-4280-a9f9-27bbc5585a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:23.910942 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8ce3fbdf-348b-4280-a9f9-27bbc5585a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.756482 Jun 26 03:05:23.911907 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 65/120] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:23 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:23.918330 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-dc416fae-60c6-4d6e-a349-89fa3c32fc25 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:23.919179 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-dc416fae-60c6-4d6e-a349-89fa3c32fc25 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:23.927167 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dc416fae-60c6-4d6e-a349-89fa3c32fc25 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:23.927587 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dc416fae-60c6-4d6e-a349-89fa3c32fc25 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:23.928359 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dc416fae-60c6-4d6e-a349-89fa3c32fc25 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:23.928793 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dc416fae-60c6-4d6e-a349-89fa3c32fc25 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:24.079245 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-aa5ebf47-38ae-4e20-a139-64091a18e886 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:24.087087 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-aa5ebf47-38ae-4e20-a139-64091a18e886 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:24.088584 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-aa5ebf47-38ae-4e20-a139-64091a18e886 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:24.089799 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-aa5ebf47-38ae-4e20-a139-64091a18e886 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.686125 Jun 26 03:05:24.090382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 56/121] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:23 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:24.095175 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6ff8b51d-6b30-4844-baf1-2d9904208144 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:24.095983 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-6ff8b51d-6b30-4844-baf1-2d9904208144 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:24.101942 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6ff8b51d-6b30-4844-baf1-2d9904208144 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:24.102538 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6ff8b51d-6b30-4844-baf1-2d9904208144 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:24.103460 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6ff8b51d-6b30-4844-baf1-2d9904208144 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:24.103948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6ff8b51d-6b30-4844-baf1-2d9904208144 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:24.542522 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-dc416fae-60c6-4d6e-a349-89fa3c32fc25 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:24.552500 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-dc416fae-60c6-4d6e-a349-89fa3c32fc25 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.638915 Jun 26 03:05:24.554389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 66/122] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:23 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:24.561081 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8a78a091-ad6f-412a-aded-88ed05843e36 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:24.562082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8a78a091-ad6f-412a-aded-88ed05843e36 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:24.582585 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8a78a091-ad6f-412a-aded-88ed05843e36 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:24.583096 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8a78a091-ad6f-412a-aded-88ed05843e36 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:24.584048 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8a78a091-ad6f-412a-aded-88ed05843e36 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:24.584906 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8a78a091-ad6f-412a-aded-88ed05843e36 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:24.629941 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-6ff8b51d-6b30-4844-baf1-2d9904208144 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:24.642068 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6ff8b51d-6b30-4844-baf1-2d9904208144 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.550468 Jun 26 03:05:24.642974 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 57/123] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:24 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:24.721016 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-bf480b5b-0acc-42e4-b355-5f27bb05263f req-fac2aa4c-c182-41db-aee8-7fab12522718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a", "tag": "d9366ecd-7ca4-4109-bdc7-b47e7cb83078"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:24.732438 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-bf480b5b-0acc-42e4-b355-5f27bb05263f req-fac2aa4c-c182-41db-aee8-7fab12522718 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:24.733246 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-bf480b5b-0acc-42e4-b355-5f27bb05263f req-fac2aa4c-c182-41db-aee8-7fab12522718 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:24.749068 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-bf480b5b-0acc-42e4-b355-5f27bb05263f req-fac2aa4c-c182-41db-aee8-7fab12522718 service nova] Creating event network-changed:d9366ecd-7ca4-4109-bdc7-b47e7cb83078 for instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a on hv-cinder-84684 Jun 26 03:05:24.756801 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-bf480b5b-0acc-42e4-b355-5f27bb05263f req-fac2aa4c-c182-41db-aee8-7fab12522718 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112413 Jun 26 03:05:24.757488 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 58/124] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:05:24.932645 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b46b35fe-8076-4781-a53d-8e32f0ad7b7e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:24.933372 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b46b35fe-8076-4781-a53d-8e32f0ad7b7e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:24.947940 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b46b35fe-8076-4781-a53d-8e32f0ad7b7e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:24.951921 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b46b35fe-8076-4781-a53d-8e32f0ad7b7e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:24.956646 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b46b35fe-8076-4781-a53d-8e32f0ad7b7e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:24.957934 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b46b35fe-8076-4781-a53d-8e32f0ad7b7e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:25.023905 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-8a78a091-ad6f-412a-aded-88ed05843e36 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:25.041496 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8a78a091-ad6f-412a-aded-88ed05843e36 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.485602 Jun 26 03:05:25.042320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 67/125] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:24 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:25.112336 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-12ab209e-2c46-40f1-952e-cac7dc664a59 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:25.112952 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-12ab209e-2c46-40f1-952e-cac7dc664a59 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:25.126549 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-12ab209e-2c46-40f1-952e-cac7dc664a59 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:25.136728 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-12ab209e-2c46-40f1-952e-cac7dc664a59 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:25.143488 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-12ab209e-2c46-40f1-952e-cac7dc664a59 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:25.154539 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-12ab209e-2c46-40f1-952e-cac7dc664a59 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:25.316010 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b46b35fe-8076-4781-a53d-8e32f0ad7b7e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:25.324778 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b46b35fe-8076-4781-a53d-8e32f0ad7b7e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.400478 Jun 26 03:05:25.335147 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 59/126] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:24 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:25.417067 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-19aca0f3-1143-4fdf-aa21-8c69d8078dcb req-5558f4c4-5a25-41ce-b2b6-e43cd9f3d1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0d1d9b-d025-442c-a2f6-db22050d9059", "tag": "52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:25.429114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-19aca0f3-1143-4fdf-aa21-8c69d8078dcb req-5558f4c4-5a25-41ce-b2b6-e43cd9f3d1e2 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:25.429565 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-19aca0f3-1143-4fdf-aa21-8c69d8078dcb req-5558f4c4-5a25-41ce-b2b6-e43cd9f3d1e2 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:25.473616 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-19aca0f3-1143-4fdf-aa21-8c69d8078dcb req-5558f4c4-5a25-41ce-b2b6-e43cd9f3d1e2 service nova] Creating event network-changed:52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f for instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 on hv-cinder-84684 Jun 26 03:05:25.485260 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-19aca0f3-1143-4fdf-aa21-8c69d8078dcb req-5558f4c4-5a25-41ce-b2b6-e43cd9f3d1e2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070241 Jun 26 03:05:25.487093 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 60/127] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:05:25.531446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-12ab209e-2c46-40f1-952e-cac7dc664a59 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:25.561255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-12ab209e-2c46-40f1-952e-cac7dc664a59 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:25.563531 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-12ab209e-2c46-40f1-952e-cac7dc664a59 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:25.571760 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8e7d524f-9b47-4d18-ac0b-cc32661f1215 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:25.572169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-12ab209e-2c46-40f1-952e-cac7dc664a59 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.464892 Jun 26 03:05:25.572515 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8e7d524f-9b47-4d18-ac0b-cc32661f1215 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:25.573576 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 68/128] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:25 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:25.586847 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8e7d524f-9b47-4d18-ac0b-cc32661f1215 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:25.589644 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8e7d524f-9b47-4d18-ac0b-cc32661f1215 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:25.598473 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8e7d524f-9b47-4d18-ac0b-cc32661f1215 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:25.598473 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8e7d524f-9b47-4d18-ac0b-cc32661f1215 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:25.660124 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-27800139-d8bf-4409-85b6-38edeb7d5e3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:25.661017 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-27800139-d8bf-4409-85b6-38edeb7d5e3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:25.674811 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-27800139-d8bf-4409-85b6-38edeb7d5e3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:25.676905 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-27800139-d8bf-4409-85b6-38edeb7d5e3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:25.679481 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-27800139-d8bf-4409-85b6-38edeb7d5e3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:25.681095 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-27800139-d8bf-4409-85b6-38edeb7d5e3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:26.090363 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8e7d524f-9b47-4d18-ac0b-cc32661f1215 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:26.098909 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8e7d524f-9b47-4d18-ac0b-cc32661f1215 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.532801 Jun 26 03:05:26.099636 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 61/129] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:25 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:26.113296 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-27800139-d8bf-4409-85b6-38edeb7d5e3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:26.115406 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5173e83c-58c8-4331-932e-871d5f43ab47 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:26.116005 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5173e83c-58c8-4331-932e-871d5f43ab47 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:26.123705 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5173e83c-58c8-4331-932e-871d5f43ab47 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:26.124162 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5173e83c-58c8-4331-932e-871d5f43ab47 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:26.125721 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5173e83c-58c8-4331-932e-871d5f43ab47 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:26.126389 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5173e83c-58c8-4331-932e-871d5f43ab47 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:26.127865 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-27800139-d8bf-4409-85b6-38edeb7d5e3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.471777 Jun 26 03:05:26.129374 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 69/130] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:25 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:26.337193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5173e83c-58c8-4331-932e-871d5f43ab47 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:26.344313 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-31c28cf3-b89d-42ff-a9aa-33226e01e382 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:26.344499 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5173e83c-58c8-4331-932e-871d5f43ab47 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.233145 Jun 26 03:05:26.345151 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 62/131] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:26 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:26.346416 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-31c28cf3-b89d-42ff-a9aa-33226e01e382 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:26.355402 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-31c28cf3-b89d-42ff-a9aa-33226e01e382 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:26.355950 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-31c28cf3-b89d-42ff-a9aa-33226e01e382 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:26.356957 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-31c28cf3-b89d-42ff-a9aa-33226e01e382 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:26.357552 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-31c28cf3-b89d-42ff-a9aa-33226e01e382 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:26.511542 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-31c28cf3-b89d-42ff-a9aa-33226e01e382 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:26.520460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-31c28cf3-b89d-42ff-a9aa-33226e01e382 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.181296 Jun 26 03:05:26.521337 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 70/132] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:26 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:26.592383 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9a990fc5-d923-454c-ad52-d0735606b728 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:26.592995 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9a990fc5-d923-454c-ad52-d0735606b728 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:26.599270 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=100 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:26.603114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9a990fc5-d923-454c-ad52-d0735606b728 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:26.603868 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9a990fc5-d923-454c-ad52-d0735606b728 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:26.604797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9a990fc5-d923-454c-ad52-d0735606b728 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:26.605420 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9a990fc5-d923-454c-ad52-d0735606b728 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:26.610830 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=100 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:26.758225 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9a990fc5-d923-454c-ad52-d0735606b728 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:26.769271 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9a990fc5-d923-454c-ad52-d0735606b728 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:26.771799 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9a990fc5-d923-454c-ad52-d0735606b728 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:26.772930 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9a990fc5-d923-454c-ad52-d0735606b728 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.184741 Jun 26 03:05:26.773491 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 63/133] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:26 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:26.775073 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-33257432-1f9e-4351-9e8e-f57402381768 req-381e7178-6d3c-40d3-82dc-c52d98277391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b753d813-95df-4256-a8c0-dcd4681dfe27", "tag": "343e4080-88b4-47fd-8dd1-6b13277216f9"}, {"name": "network-changed", "server_uuid": "1c55ca6d-bad0-4964-83fe-4352b7fb1b1d", "tag": "2d68efe6-d264-4cfb-8cd4-414d529eb007"}, {"name": "network-changed", "server_uuid": "d87611df-64cb-42cb-b734-782bf9ebb9ab", "tag": "964b9885-7663-4cc6-bfd4-5bb8f0e20bea"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:26.789344 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-33257432-1f9e-4351-9e8e-f57402381768 req-381e7178-6d3c-40d3-82dc-c52d98277391 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:26.789800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-33257432-1f9e-4351-9e8e-f57402381768 req-381e7178-6d3c-40d3-82dc-c52d98277391 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:26.813562 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-33257432-1f9e-4351-9e8e-f57402381768 req-381e7178-6d3c-40d3-82dc-c52d98277391 service nova] Creating event network-changed:343e4080-88b4-47fd-8dd1-6b13277216f9 for instance b753d813-95df-4256-a8c0-dcd4681dfe27 on hv-cinder-84684 Jun 26 03:05:26.814377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-33257432-1f9e-4351-9e8e-f57402381768 req-381e7178-6d3c-40d3-82dc-c52d98277391 service nova] Creating event network-changed:2d68efe6-d264-4cfb-8cd4-414d529eb007 for instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d on hv-cinder-84684 Jun 26 03:05:26.815098 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-33257432-1f9e-4351-9e8e-f57402381768 req-381e7178-6d3c-40d3-82dc-c52d98277391 service nova] Creating event network-changed:964b9885-7663-4cc6-bfd4-5bb8f0e20bea for instance d87611df-64cb-42cb-b734-782bf9ebb9ab on hv-cinder-84684 Jun 26 03:05:26.815938 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-33257432-1f9e-4351-9e8e-f57402381768 req-381e7178-6d3c-40d3-82dc-c52d98277391 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117783) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 26 03:05:26.817274 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e0e6b8a3-f743-4b3c-bad0-43264f142417 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:26.817802 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e0e6b8a3-f743-4b3c-bad0-43264f142417 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:26.818666 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e0e6b8a3-f743-4b3c-bad0-43264f142417 None None] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:26.819177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e0e6b8a3-f743-4b3c-bad0-43264f142417 None None] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:26.829164 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.compute.rpcapi [None req-e0e6b8a3-f743-4b3c-bad0-43264f142417 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 26 03:05:26.830182 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e0e6b8a3-f743-4b3c-bad0-43264f142417 None None] Releasing lock "compute-rpcapi-router" {{(pid=117783) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 26 03:05:26.874086 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e0e6b8a3-f743-4b3c-bad0-43264f142417 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.102388 Jun 26 03:05:26.874704 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 71/134] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:05:27.116405 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a2210798-6c0f-4f6c-ac97-9963a50b35d3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:27.117074 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a2210798-6c0f-4f6c-ac97-9963a50b35d3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:27.124543 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a2210798-6c0f-4f6c-ac97-9963a50b35d3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:27.125576 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a2210798-6c0f-4f6c-ac97-9963a50b35d3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:27.126910 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a2210798-6c0f-4f6c-ac97-9963a50b35d3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:27.127356 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a2210798-6c0f-4f6c-ac97-9963a50b35d3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:27.146951 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-47909d24-bba6-4eae-ad1b-a6e9ef805280 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:27.148656 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-47909d24-bba6-4eae-ad1b-a6e9ef805280 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:27.157176 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47909d24-bba6-4eae-ad1b-a6e9ef805280 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:27.157916 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47909d24-bba6-4eae-ad1b-a6e9ef805280 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:27.159028 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47909d24-bba6-4eae-ad1b-a6e9ef805280 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:27.159686 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47909d24-bba6-4eae-ad1b-a6e9ef805280 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:27.342667 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a2210798-6c0f-4f6c-ac97-9963a50b35d3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:27.353827 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-47909d24-bba6-4eae-ad1b-a6e9ef805280 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:27.356957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a2210798-6c0f-4f6c-ac97-9963a50b35d3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.244659 Jun 26 03:05:27.357539 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 64/135] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:27 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:27.364330 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c2d6b283-f53a-4083-8233-28d95bca4fe4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:27.364926 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c2d6b283-f53a-4083-8233-28d95bca4fe4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:27.370735 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c2d6b283-f53a-4083-8233-28d95bca4fe4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:27.371395 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c2d6b283-f53a-4083-8233-28d95bca4fe4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:27.372307 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c2d6b283-f53a-4083-8233-28d95bca4fe4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:27.372517 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-47909d24-bba6-4eae-ad1b-a6e9ef805280 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.230811 Jun 26 03:05:27.372740 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c2d6b283-f53a-4083-8233-28d95bca4fe4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:27.373377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 72/136] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:27 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:27.529295 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c2d6b283-f53a-4083-8233-28d95bca4fe4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:27.537410 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d59fdd03-e35a-47ca-8a08-03f04d8fd2b5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:27.538250 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d59fdd03-e35a-47ca-8a08-03f04d8fd2b5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:27.540509 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c2d6b283-f53a-4083-8233-28d95bca4fe4 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.181876 Jun 26 03:05:27.541465 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 65/137] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:27 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:27.554079 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d59fdd03-e35a-47ca-8a08-03f04d8fd2b5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:27.554793 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d59fdd03-e35a-47ca-8a08-03f04d8fd2b5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:27.555733 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d59fdd03-e35a-47ca-8a08-03f04d8fd2b5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:27.556176 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d59fdd03-e35a-47ca-8a08-03f04d8fd2b5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:27.704945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d59fdd03-e35a-47ca-8a08-03f04d8fd2b5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:27.712453 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d59fdd03-e35a-47ca-8a08-03f04d8fd2b5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.179588 Jun 26 03:05:27.713028 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 73/138] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:27 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:27.791594 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f8c040b5-6067-47af-9538-8881a715b645 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:27.792207 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f8c040b5-6067-47af-9538-8881a715b645 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:27.799438 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f8c040b5-6067-47af-9538-8881a715b645 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:27.799881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f8c040b5-6067-47af-9538-8881a715b645 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:27.800831 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f8c040b5-6067-47af-9538-8881a715b645 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:27.801279 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f8c040b5-6067-47af-9538-8881a715b645 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:27.947586 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f8c040b5-6067-47af-9538-8881a715b645 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:27.955748 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f8c040b5-6067-47af-9538-8881a715b645 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:27.957358 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f8c040b5-6067-47af-9538-8881a715b645 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:27.958567 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f8c040b5-6067-47af-9538-8881a715b645 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.170784 Jun 26 03:05:27.959202 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 66/139] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:27 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:05:28.375969 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3b249429-6f5d-4251-8d89-ecfbe90fae7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:28.376678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3b249429-6f5d-4251-8d89-ecfbe90fae7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:28.385435 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b249429-6f5d-4251-8d89-ecfbe90fae7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:28.385893 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b249429-6f5d-4251-8d89-ecfbe90fae7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:28.387214 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b249429-6f5d-4251-8d89-ecfbe90fae7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:28.387658 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b249429-6f5d-4251-8d89-ecfbe90fae7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:28.394869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-792c4a05-81fb-41d0-8f2a-cac13f0d1cca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:28.395889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-792c4a05-81fb-41d0-8f2a-cac13f0d1cca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:28.402442 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-792c4a05-81fb-41d0-8f2a-cac13f0d1cca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:28.403212 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-792c4a05-81fb-41d0-8f2a-cac13f0d1cca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:28.404162 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-792c4a05-81fb-41d0-8f2a-cac13f0d1cca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:28.404841 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-792c4a05-81fb-41d0-8f2a-cac13f0d1cca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:28.611504 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3b249429-6f5d-4251-8d89-ecfbe90fae7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:28.618908 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3b249429-6f5d-4251-8d89-ecfbe90fae7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.248170 Jun 26 03:05:28.619494 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 74/140] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:28 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:28.619708 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-792c4a05-81fb-41d0-8f2a-cac13f0d1cca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:28.623834 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2b322abb-a4bf-42b3-9fcf-2d287bc9db17 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:28.624651 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2b322abb-a4bf-42b3-9fcf-2d287bc9db17 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:28.631575 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-792c4a05-81fb-41d0-8f2a-cac13f0d1cca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.241192 Jun 26 03:05:28.632142 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2b322abb-a4bf-42b3-9fcf-2d287bc9db17 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:28.632537 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 67/141] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:28 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:28.642318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2b322abb-a4bf-42b3-9fcf-2d287bc9db17 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:28.643255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2b322abb-a4bf-42b3-9fcf-2d287bc9db17 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:28.643735 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2b322abb-a4bf-42b3-9fcf-2d287bc9db17 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:28.729864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d626bceb-c95b-49f7-a218-f029a22185cd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:28.730445 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d626bceb-c95b-49f7-a218-f029a22185cd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:28.742246 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d626bceb-c95b-49f7-a218-f029a22185cd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:28.747125 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d626bceb-c95b-49f7-a218-f029a22185cd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:28.747929 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d626bceb-c95b-49f7-a218-f029a22185cd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:28.748380 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d626bceb-c95b-49f7-a218-f029a22185cd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:28.844590 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-2b322abb-a4bf-42b3-9fcf-2d287bc9db17 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:28.861701 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2b322abb-a4bf-42b3-9fcf-2d287bc9db17 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.240317 Jun 26 03:05:28.863342 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 75/142] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:28 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:28.920055 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d626bceb-c95b-49f7-a218-f029a22185cd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:28.928442 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d626bceb-c95b-49f7-a218-f029a22185cd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.203352 Jun 26 03:05:28.929011 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 68/143] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:28 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:28.976681 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3c22a2d2-1169-439d-9c80-f442c11edff2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:28.977219 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3c22a2d2-1169-439d-9c80-f442c11edff2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:28.983236 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c22a2d2-1169-439d-9c80-f442c11edff2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:28.983687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c22a2d2-1169-439d-9c80-f442c11edff2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:28.984956 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c22a2d2-1169-439d-9c80-f442c11edff2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:28.985392 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c22a2d2-1169-439d-9c80-f442c11edff2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:29.107408 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3c22a2d2-1169-439d-9c80-f442c11edff2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:29.115867 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3c22a2d2-1169-439d-9c80-f442c11edff2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:29.117371 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3c22a2d2-1169-439d-9c80-f442c11edff2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:29.118498 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3c22a2d2-1169-439d-9c80-f442c11edff2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.145761 Jun 26 03:05:29.119054 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 76/144] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:28 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:29.636676 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-90bd92e2-eb68-4fb4-8365-d8dbf4278ae5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:29.637288 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-90bd92e2-eb68-4fb4-8365-d8dbf4278ae5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:29.643787 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-90bd92e2-eb68-4fb4-8365-d8dbf4278ae5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:29.644239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-90bd92e2-eb68-4fb4-8365-d8dbf4278ae5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:29.645268 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-90bd92e2-eb68-4fb4-8365-d8dbf4278ae5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:29.645707 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-90bd92e2-eb68-4fb4-8365-d8dbf4278ae5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:29.648894 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-10e10318-04a0-4602-9788-20257e13f797 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:29.649505 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-10e10318-04a0-4602-9788-20257e13f797 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:29.655297 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-10e10318-04a0-4602-9788-20257e13f797 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:29.655747 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-10e10318-04a0-4602-9788-20257e13f797 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:29.657148 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-10e10318-04a0-4602-9788-20257e13f797 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:29.657584 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-10e10318-04a0-4602-9788-20257e13f797 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:29.839944 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-90bd92e2-eb68-4fb4-8365-d8dbf4278ae5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:29.844795 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-10e10318-04a0-4602-9788-20257e13f797 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:29.848120 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-90bd92e2-eb68-4fb4-8365-d8dbf4278ae5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.215551 Jun 26 03:05:29.848698 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 69/145] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:29 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:29.859944 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-10e10318-04a0-4602-9788-20257e13f797 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.214605 Jun 26 03:05:29.860586 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 77/146] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:29 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:29.892900 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f407454f-f1cd-4425-8542-ec8bfcc28275 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:29.893668 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f407454f-f1cd-4425-8542-ec8bfcc28275 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:29.899473 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f407454f-f1cd-4425-8542-ec8bfcc28275 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:29.899913 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f407454f-f1cd-4425-8542-ec8bfcc28275 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:29.900656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f407454f-f1cd-4425-8542-ec8bfcc28275 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:29.901096 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f407454f-f1cd-4425-8542-ec8bfcc28275 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:29.945771 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-751627d3-fc1b-438d-8d5b-8cd4c0604a4a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:29.946416 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-751627d3-fc1b-438d-8d5b-8cd4c0604a4a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:29.952174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-751627d3-fc1b-438d-8d5b-8cd4c0604a4a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:29.952619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-751627d3-fc1b-438d-8d5b-8cd4c0604a4a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:29.953899 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-751627d3-fc1b-438d-8d5b-8cd4c0604a4a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:29.954361 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-751627d3-fc1b-438d-8d5b-8cd4c0604a4a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:30.083593 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f407454f-f1cd-4425-8542-ec8bfcc28275 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:30.091070 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f407454f-f1cd-4425-8542-ec8bfcc28275 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.202511 Jun 26 03:05:30.091644 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 70/147] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:29 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:30.112940 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-751627d3-fc1b-438d-8d5b-8cd4c0604a4a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:30.120359 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-751627d3-fc1b-438d-8d5b-8cd4c0604a4a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.178376 Jun 26 03:05:30.120912 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 78/148] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:29 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:30.136447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6529955d-5d4e-4822-b690-cfbf2e69235c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:30.137222 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-6529955d-5d4e-4822-b690-cfbf2e69235c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:30.143908 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6529955d-5d4e-4822-b690-cfbf2e69235c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:30.144289 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6529955d-5d4e-4822-b690-cfbf2e69235c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:30.145032 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6529955d-5d4e-4822-b690-cfbf2e69235c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:30.145458 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6529955d-5d4e-4822-b690-cfbf2e69235c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:30.272860 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-6529955d-5d4e-4822-b690-cfbf2e69235c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:30.280647 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-6529955d-5d4e-4822-b690-cfbf2e69235c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:30.282180 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-6529955d-5d4e-4822-b690-cfbf2e69235c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:30.283269 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6529955d-5d4e-4822-b690-cfbf2e69235c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.150627 Jun 26 03:05:30.283820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 71/149] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:30 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:30.865042 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-efb0db1a-c3e6-4d6f-8974-080e39cc6073 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:30.865663 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-efb0db1a-c3e6-4d6f-8974-080e39cc6073 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:30.872129 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-efb0db1a-c3e6-4d6f-8974-080e39cc6073 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:30.872702 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-efb0db1a-c3e6-4d6f-8974-080e39cc6073 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:30.873480 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-efb0db1a-c3e6-4d6f-8974-080e39cc6073 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:30.873925 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-efb0db1a-c3e6-4d6f-8974-080e39cc6073 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:30.875919 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-55d18b2c-2720-4e06-8e65-5f0c7a5ef641 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:30.876525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-55d18b2c-2720-4e06-8e65-5f0c7a5ef641 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:30.884025 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-55d18b2c-2720-4e06-8e65-5f0c7a5ef641 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:30.884480 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-55d18b2c-2720-4e06-8e65-5f0c7a5ef641 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:30.885382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-55d18b2c-2720-4e06-8e65-5f0c7a5ef641 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:30.885826 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-55d18b2c-2720-4e06-8e65-5f0c7a5ef641 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:31.069516 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-efb0db1a-c3e6-4d6f-8974-080e39cc6073 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:31.073153 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-55d18b2c-2720-4e06-8e65-5f0c7a5ef641 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:31.077451 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-efb0db1a-c3e6-4d6f-8974-080e39cc6073 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.216165 Jun 26 03:05:31.078163 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 79/150] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:30 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:31.080941 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-55d18b2c-2720-4e06-8e65-5f0c7a5ef641 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.208727 Jun 26 03:05:31.081491 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 72/151] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:30 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:31.107864 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-dc8764fe-bde1-4b79-a174-f70f65e87488 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:31.108429 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-dc8764fe-bde1-4b79-a174-f70f65e87488 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:31.115117 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dc8764fe-bde1-4b79-a174-f70f65e87488 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:31.115559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dc8764fe-bde1-4b79-a174-f70f65e87488 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:31.116311 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dc8764fe-bde1-4b79-a174-f70f65e87488 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:31.116738 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dc8764fe-bde1-4b79-a174-f70f65e87488 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:31.138173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-39a6d8c2-1a1c-44c8-b3b9-a15c2c03dc91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:31.138896 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-39a6d8c2-1a1c-44c8-b3b9-a15c2c03dc91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:31.146355 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-39a6d8c2-1a1c-44c8-b3b9-a15c2c03dc91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:31.147068 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-39a6d8c2-1a1c-44c8-b3b9-a15c2c03dc91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:31.147880 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-39a6d8c2-1a1c-44c8-b3b9-a15c2c03dc91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:31.148325 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-39a6d8c2-1a1c-44c8-b3b9-a15c2c03dc91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:31.327587 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-dc8764fe-bde1-4b79-a174-f70f65e87488 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:31.333535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-39a6d8c2-1a1c-44c8-b3b9-a15c2c03dc91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:31.338695 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-dc8764fe-bde1-4b79-a174-f70f65e87488 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.234550 Jun 26 03:05:31.344157 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-39a6d8c2-1a1c-44c8-b3b9-a15c2c03dc91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.209548 Jun 26 03:05:31.350653 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 73/152] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:31 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:31.350813 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 80/153] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:31 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:31.350898 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-94b25e61-78d2-4fd6-a861-dfe951b63f16 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:31.350898 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-94b25e61-78d2-4fd6-a861-dfe951b63f16 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:31.355993 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94b25e61-78d2-4fd6-a861-dfe951b63f16 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:31.356448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94b25e61-78d2-4fd6-a861-dfe951b63f16 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:31.357242 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94b25e61-78d2-4fd6-a861-dfe951b63f16 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:31.357682 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94b25e61-78d2-4fd6-a861-dfe951b63f16 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:31.488480 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-94b25e61-78d2-4fd6-a861-dfe951b63f16 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:31.496428 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-94b25e61-78d2-4fd6-a861-dfe951b63f16 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:31.497917 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-94b25e61-78d2-4fd6-a861-dfe951b63f16 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:31.499061 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-94b25e61-78d2-4fd6-a861-dfe951b63f16 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.153265 Jun 26 03:05:31.500315 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 74/154] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:31 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:32.094522 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f1aa707b-5d69-471c-b113-e79e95d41e48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:32.095229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f1aa707b-5d69-471c-b113-e79e95d41e48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:32.097127 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d1ae92c6-eb1f-4dc2-b62b-1b14d3f3fe9f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:32.097953 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d1ae92c6-eb1f-4dc2-b62b-1b14d3f3fe9f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:32.101331 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f1aa707b-5d69-471c-b113-e79e95d41e48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:32.101847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f1aa707b-5d69-471c-b113-e79e95d41e48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:32.102718 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f1aa707b-5d69-471c-b113-e79e95d41e48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:32.103212 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f1aa707b-5d69-471c-b113-e79e95d41e48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:32.104569 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d1ae92c6-eb1f-4dc2-b62b-1b14d3f3fe9f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:32.105480 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d1ae92c6-eb1f-4dc2-b62b-1b14d3f3fe9f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:32.106781 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d1ae92c6-eb1f-4dc2-b62b-1b14d3f3fe9f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:32.107441 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d1ae92c6-eb1f-4dc2-b62b-1b14d3f3fe9f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:32.108338 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=100 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:32.946005 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d1ae92c6-eb1f-4dc2-b62b-1b14d3f3fe9f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:32.953584 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d1ae92c6-eb1f-4dc2-b62b-1b14d3f3fe9f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.860446 Jun 26 03:05:32.953953 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f1aa707b-5d69-471c-b113-e79e95d41e48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:32.957450 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 75/155] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:32 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:32.962106 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-0cb5a4e5-e11f-496a-8a39-682c061909b5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:32.962232 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f1aa707b-5d69-471c-b113-e79e95d41e48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.872004 Jun 26 03:05:32.962663 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-0cb5a4e5-e11f-496a-8a39-682c061909b5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:32.962944 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 81/156] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:32 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:32.967473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-5e6f52f4-6a0e-4f29-ae7d-b3cac913569b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:32.968188 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-5e6f52f4-6a0e-4f29-ae7d-b3cac913569b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:32.968791 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0cb5a4e5-e11f-496a-8a39-682c061909b5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:32.969235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0cb5a4e5-e11f-496a-8a39-682c061909b5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:32.969992 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0cb5a4e5-e11f-496a-8a39-682c061909b5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:32.970449 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0cb5a4e5-e11f-496a-8a39-682c061909b5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:32.971341 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=100 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:32.974824 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5e6f52f4-6a0e-4f29-ae7d-b3cac913569b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:32.975337 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5e6f52f4-6a0e-4f29-ae7d-b3cac913569b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:32.976166 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5e6f52f4-6a0e-4f29-ae7d-b3cac913569b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:32.976692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5e6f52f4-6a0e-4f29-ae7d-b3cac913569b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:33.177583 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-0cb5a4e5-e11f-496a-8a39-682c061909b5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:33.179052 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-5e6f52f4-6a0e-4f29-ae7d-b3cac913569b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:33.189137 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-5e6f52f4-6a0e-4f29-ae7d-b3cac913569b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.224936 Jun 26 03:05:33.189813 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 82/157] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:32 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:33.195267 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3f600022-39ed-4b3f-afd1-b57bfbd2fd1c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:33.195940 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3f600022-39ed-4b3f-afd1-b57bfbd2fd1c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:33.201822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3f600022-39ed-4b3f-afd1-b57bfbd2fd1c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:33.202320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3f600022-39ed-4b3f-afd1-b57bfbd2fd1c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:33.203777 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3f600022-39ed-4b3f-afd1-b57bfbd2fd1c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:33.204244 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3f600022-39ed-4b3f-afd1-b57bfbd2fd1c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:33.204885 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-0cb5a4e5-e11f-496a-8a39-682c061909b5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.246118 Jun 26 03:05:33.206557 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 76/158] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:32 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:33.350837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3f600022-39ed-4b3f-afd1-b57bfbd2fd1c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:33.358799 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3f600022-39ed-4b3f-afd1-b57bfbd2fd1c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:33.360942 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3f600022-39ed-4b3f-afd1-b57bfbd2fd1c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:33.362057 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3f600022-39ed-4b3f-afd1-b57bfbd2fd1c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.171107 Jun 26 03:05:33.362621 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 83/159] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:33 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:33.970381 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8ad770d2-366c-44bf-b1bc-3f7aee940929 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:33.970995 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8ad770d2-366c-44bf-b1bc-3f7aee940929 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:33.972845 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=2 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:33.979165 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8ad770d2-366c-44bf-b1bc-3f7aee940929 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:33.979620 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8ad770d2-366c-44bf-b1bc-3f7aee940929 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:33.980395 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8ad770d2-366c-44bf-b1bc-3f7aee940929 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:33.980811 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-7c43e9ba-82e1-4bbc-a738-5d5d6d5bb91d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:33.980932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8ad770d2-366c-44bf-b1bc-3f7aee940929 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:33.981622 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-7c43e9ba-82e1-4bbc-a738-5d5d6d5bb91d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:33.990443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7c43e9ba-82e1-4bbc-a738-5d5d6d5bb91d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:33.991299 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7c43e9ba-82e1-4bbc-a738-5d5d6d5bb91d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:33.992277 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7c43e9ba-82e1-4bbc-a738-5d5d6d5bb91d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:33.992964 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7c43e9ba-82e1-4bbc-a738-5d5d6d5bb91d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:34.180672 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8ad770d2-366c-44bf-b1bc-3f7aee940929 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:34.184908 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-7c43e9ba-82e1-4bbc-a738-5d5d6d5bb91d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:34.189211 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8ad770d2-366c-44bf-b1bc-3f7aee940929 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.222684 Jun 26 03:05:34.189819 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 77/160] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:33 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:34.194156 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-7c43e9ba-82e1-4bbc-a738-5d5d6d5bb91d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.219269 Jun 26 03:05:34.194717 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 84/161] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:33 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:34.206663 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-50f13561-bed1-4315-8d13-7de9bc59ef69 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:34.207263 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-50f13561-bed1-4315-8d13-7de9bc59ef69 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:34.212926 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-50f13561-bed1-4315-8d13-7de9bc59ef69 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:34.213369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-50f13561-bed1-4315-8d13-7de9bc59ef69 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:34.214139 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-50f13561-bed1-4315-8d13-7de9bc59ef69 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:34.214577 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-50f13561-bed1-4315-8d13-7de9bc59ef69 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:34.222989 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-df9f5c9d-405b-4656-ab5c-445207196f3f tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:34.223667 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-df9f5c9d-405b-4656-ab5c-445207196f3f tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:34.229874 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-df9f5c9d-405b-4656-ab5c-445207196f3f tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:34.230361 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-df9f5c9d-405b-4656-ab5c-445207196f3f tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:34.231124 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-df9f5c9d-405b-4656-ab5c-445207196f3f tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:34.231561 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-df9f5c9d-405b-4656-ab5c-445207196f3f tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:34.427540 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-50f13561-bed1-4315-8d13-7de9bc59ef69 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:34.434777 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-50f13561-bed1-4315-8d13-7de9bc59ef69 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.232177 Jun 26 03:05:34.444301 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 78/162] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:34 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:34.444802 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-df9f5c9d-405b-4656-ab5c-445207196f3f tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:34.446005 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-528bb766-7111-453f-9df7-564df6a8ed04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:34.446670 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-528bb766-7111-453f-9df7-564df6a8ed04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:34.452700 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-528bb766-7111-453f-9df7-564df6a8ed04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:34.453166 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-df9f5c9d-405b-4656-ab5c-445207196f3f tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.233685 Jun 26 03:05:34.453294 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-528bb766-7111-453f-9df7-564df6a8ed04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:34.453745 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 85/163] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:34 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:34.462231 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-528bb766-7111-453f-9df7-564df6a8ed04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:34.462231 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-528bb766-7111-453f-9df7-564df6a8ed04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:34.624509 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-528bb766-7111-453f-9df7-564df6a8ed04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:34.632780 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=100 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:34.637792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-528bb766-7111-453f-9df7-564df6a8ed04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:34.640310 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-528bb766-7111-453f-9df7-564df6a8ed04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:34.642000 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-528bb766-7111-453f-9df7-564df6a8ed04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.205608 Jun 26 03:05:34.642919 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 79/164] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:34 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:34.919982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-0e16c1e3-fc95-4476-9bf5-8f94eb10c22e req-6c78249e-5631-4ce4-9a83-eef7e1a24288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0d1d9b-d025-442c-a2f6-db22050d9059", "name": "network-vif-plugged", "status": "completed", "tag": "52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:34.938989 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-0e16c1e3-fc95-4476-9bf5-8f94eb10c22e req-6c78249e-5631-4ce4-9a83-eef7e1a24288 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:34.939537 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-0e16c1e3-fc95-4476-9bf5-8f94eb10c22e req-6c78249e-5631-4ce4-9a83-eef7e1a24288 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:34.953466 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-0e16c1e3-fc95-4476-9bf5-8f94eb10c22e req-6c78249e-5631-4ce4-9a83-eef7e1a24288 service nova] Creating event network-vif-plugged:52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f for instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 on hv-cinder-84684 Jun 26 03:05:34.960450 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-0e16c1e3-fc95-4476-9bf5-8f94eb10c22e req-6c78249e-5631-4ce4-9a83-eef7e1a24288 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138863 Jun 26 03:05:34.961171 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 86/165] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:05:35.211876 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3a02c925-6042-4761-8057-c2a75ecf98b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:35.213464 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-130f5ef4-e938-4c25-83d0-28ddc367eb84 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:35.214105 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-130f5ef4-e938-4c25-83d0-28ddc367eb84 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:35.214310 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3a02c925-6042-4761-8057-c2a75ecf98b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:35.229809 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a02c925-6042-4761-8057-c2a75ecf98b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:35.230333 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-130f5ef4-e938-4c25-83d0-28ddc367eb84 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:35.231114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-130f5ef4-e938-4c25-83d0-28ddc367eb84 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:35.231726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a02c925-6042-4761-8057-c2a75ecf98b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:35.233140 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-130f5ef4-e938-4c25-83d0-28ddc367eb84 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:35.234987 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a02c925-6042-4761-8057-c2a75ecf98b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:35.235605 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a02c925-6042-4761-8057-c2a75ecf98b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:35.236741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-130f5ef4-e938-4c25-83d0-28ddc367eb84 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:35.785622 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3a02c925-6042-4761-8057-c2a75ecf98b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:35.788950 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-130f5ef4-e938-4c25-83d0-28ddc367eb84 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:35.796148 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3a02c925-6042-4761-8057-c2a75ecf98b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.589121 Jun 26 03:05:35.796461 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-130f5ef4-e938-4c25-83d0-28ddc367eb84 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.594390 Jun 26 03:05:35.797567 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 80/166] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:35 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:35.805915 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3df1a2b9-68ce-4076-8fc3-af483edff395 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:35.810739 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3df1a2b9-68ce-4076-8fc3-af483edff395 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:35.813861 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 87/167] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:35 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:35.820330 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-acf2393e-8e22-4da1-ade5-6c0e1207b3c1 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:35.821084 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-acf2393e-8e22-4da1-ade5-6c0e1207b3c1 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:35.824345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3df1a2b9-68ce-4076-8fc3-af483edff395 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:35.825223 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3df1a2b9-68ce-4076-8fc3-af483edff395 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:35.825998 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3df1a2b9-68ce-4076-8fc3-af483edff395 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:35.826451 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3df1a2b9-68ce-4076-8fc3-af483edff395 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:35.828765 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-acf2393e-8e22-4da1-ade5-6c0e1207b3c1 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:35.829507 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-acf2393e-8e22-4da1-ade5-6c0e1207b3c1 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:35.830598 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-acf2393e-8e22-4da1-ade5-6c0e1207b3c1 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:35.831248 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-acf2393e-8e22-4da1-ade5-6c0e1207b3c1 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:36.068397 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-acf2393e-8e22-4da1-ade5-6c0e1207b3c1 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:36.076692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-acf2393e-8e22-4da1-ade5-6c0e1207b3c1 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.260402 Jun 26 03:05:36.079234 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 88/168] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:35 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:36.089461 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f5687a95-7d9a-4f64-945a-b0866933dfae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:36.090494 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f5687a95-7d9a-4f64-945a-b0866933dfae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:36.104401 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f5687a95-7d9a-4f64-945a-b0866933dfae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:36.104868 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f5687a95-7d9a-4f64-945a-b0866933dfae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:36.110446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f5687a95-7d9a-4f64-945a-b0866933dfae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:36.110993 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f5687a95-7d9a-4f64-945a-b0866933dfae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:36.121109 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-3df1a2b9-68ce-4076-8fc3-af483edff395 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:36.129827 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3df1a2b9-68ce-4076-8fc3-af483edff395 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.327461 Jun 26 03:05:36.132886 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 81/169] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:35 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:36.273440 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f5687a95-7d9a-4f64-945a-b0866933dfae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:36.282873 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f5687a95-7d9a-4f64-945a-b0866933dfae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:36.284451 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f5687a95-7d9a-4f64-945a-b0866933dfae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:36.285728 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f5687a95-7d9a-4f64-945a-b0866933dfae tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.205443 Jun 26 03:05:36.286482 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 89/170] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:36 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:36.813116 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-eed69162-3c47-4a20-a7a7-ac2dde196703 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:36.813713 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-eed69162-3c47-4a20-a7a7-ac2dde196703 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:36.819820 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9b73e257-e155-4907-97d8-8ec036457113 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:36.820721 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9b73e257-e155-4907-97d8-8ec036457113 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:36.827754 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eed69162-3c47-4a20-a7a7-ac2dde196703 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:36.828715 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=2 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:36.828832 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eed69162-3c47-4a20-a7a7-ac2dde196703 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:36.829486 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eed69162-3c47-4a20-a7a7-ac2dde196703 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:36.829922 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eed69162-3c47-4a20-a7a7-ac2dde196703 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:36.831155 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9b73e257-e155-4907-97d8-8ec036457113 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:36.831842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9b73e257-e155-4907-97d8-8ec036457113 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:36.833021 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9b73e257-e155-4907-97d8-8ec036457113 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:36.833837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9b73e257-e155-4907-97d8-8ec036457113 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:37.589424 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-eed69162-3c47-4a20-a7a7-ac2dde196703 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:37.615375 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-eed69162-3c47-4a20-a7a7-ac2dde196703 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.802375 Jun 26 03:05:37.616903 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 82/171] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:36 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:37.632955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-fd14f3b7-7a87-4f10-81e7-dba72660b945 req-b14ec21e-f27c-4852-98c9-0ae0c5dc0bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cddc852a-2aa2-4a44-ad1a-e9e930e3bddf", "name": "network-vif-plugged", "status": "completed", "tag": "634b866a-e4dd-43d0-84a2-3a0a964abbff"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:37.638492 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9b73e257-e155-4907-97d8-8ec036457113 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:37.657452 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-fd14f3b7-7a87-4f10-81e7-dba72660b945 req-b14ec21e-f27c-4852-98c9-0ae0c5dc0bf1 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:37.658265 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-fd14f3b7-7a87-4f10-81e7-dba72660b945 req-b14ec21e-f27c-4852-98c9-0ae0c5dc0bf1 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:37.659875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9b73e257-e155-4907-97d8-8ec036457113 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.841831 Jun 26 03:05:37.666755 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 90/172] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:36 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:37.687774 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-66ee324e-24c3-4a3f-8f36-5010ffcdbea8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:37.691338 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-66ee324e-24c3-4a3f-8f36-5010ffcdbea8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:37.695428 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-fd14f3b7-7a87-4f10-81e7-dba72660b945 req-b14ec21e-f27c-4852-98c9-0ae0c5dc0bf1 service nova] Creating event network-vif-plugged:634b866a-e4dd-43d0-84a2-3a0a964abbff for instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf on hv-cinder-84684 Jun 26 03:05:37.708055 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-fd14f3b7-7a87-4f10-81e7-dba72660b945 req-b14ec21e-f27c-4852-98c9-0ae0c5dc0bf1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089429 Jun 26 03:05:37.712575 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 83/173] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:05:37.714443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-66ee324e-24c3-4a3f-8f36-5010ffcdbea8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:37.716948 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-66ee324e-24c3-4a3f-8f36-5010ffcdbea8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:37.721690 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-66ee324e-24c3-4a3f-8f36-5010ffcdbea8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:37.724132 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-66ee324e-24c3-4a3f-8f36-5010ffcdbea8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:37.729291 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e9ae6383-fdf3-4d2e-8f2a-6c69cec89e1c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:37.730257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e9ae6383-fdf3-4d2e-8f2a-6c69cec89e1c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:37.786841 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e9ae6383-fdf3-4d2e-8f2a-6c69cec89e1c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:37.787420 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e9ae6383-fdf3-4d2e-8f2a-6c69cec89e1c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:37.793072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e9ae6383-fdf3-4d2e-8f2a-6c69cec89e1c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:37.794810 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e9ae6383-fdf3-4d2e-8f2a-6c69cec89e1c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:38.411404 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-66ee324e-24c3-4a3f-8f36-5010ffcdbea8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:38.420509 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-66ee324e-24c3-4a3f-8f36-5010ffcdbea8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.749362 Jun 26 03:05:38.423831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 91/174] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:37 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:38.431310 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e9ae6383-fdf3-4d2e-8f2a-6c69cec89e1c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:38.437527 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-cd6368ff-acd0-4d96-bd84-3c7a062c5394 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:38.438467 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-cd6368ff-acd0-4d96-bd84-3c7a062c5394 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:38.439179 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e9ae6383-fdf3-4d2e-8f2a-6c69cec89e1c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.725203 Jun 26 03:05:38.439802 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 84/175] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:37 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:38.454658 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cd6368ff-acd0-4d96-bd84-3c7a062c5394 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:38.455416 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cd6368ff-acd0-4d96-bd84-3c7a062c5394 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:38.456439 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cd6368ff-acd0-4d96-bd84-3c7a062c5394 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:38.457091 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cd6368ff-acd0-4d96-bd84-3c7a062c5394 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:38.634526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d4557890-6a8e-4d20-bd16-57e5a631517d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:38.635149 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d4557890-6a8e-4d20-bd16-57e5a631517d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:38.644672 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4557890-6a8e-4d20-bd16-57e5a631517d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:38.645131 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4557890-6a8e-4d20-bd16-57e5a631517d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:38.645889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4557890-6a8e-4d20-bd16-57e5a631517d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:38.646421 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4557890-6a8e-4d20-bd16-57e5a631517d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:39.016966 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-cd6368ff-acd0-4d96-bd84-3c7a062c5394 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:39.029068 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-cd6368ff-acd0-4d96-bd84-3c7a062c5394 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:39.031731 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-cd6368ff-acd0-4d96-bd84-3c7a062c5394 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:39.033169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-cd6368ff-acd0-4d96-bd84-3c7a062c5394 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.608191 Jun 26 03:05:39.033727 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 92/176] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:38 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:39.050466 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e566934a-69cd-433d-a4be-5d895f17c11b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:39.051566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e566934a-69cd-433d-a4be-5d895f17c11b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:39.058904 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e566934a-69cd-433d-a4be-5d895f17c11b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:39.059353 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e566934a-69cd-433d-a4be-5d895f17c11b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:39.060585 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e566934a-69cd-433d-a4be-5d895f17c11b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:39.061089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e566934a-69cd-433d-a4be-5d895f17c11b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:39.090884 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d4557890-6a8e-4d20-bd16-57e5a631517d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:39.099353 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d4557890-6a8e-4d20-bd16-57e5a631517d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.470208 Jun 26 03:05:39.099854 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 85/177] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:38 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:39.229356 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e566934a-69cd-433d-a4be-5d895f17c11b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:39.238270 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e566934a-69cd-433d-a4be-5d895f17c11b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.192369 Jun 26 03:05:39.238858 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 93/178] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:39 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:39.439555 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-94ee7176-0c60-437e-ad7d-adc63e50c827 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:39.440361 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-94ee7176-0c60-437e-ad7d-adc63e50c827 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:39.446169 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94ee7176-0c60-437e-ad7d-adc63e50c827 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:39.446619 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94ee7176-0c60-437e-ad7d-adc63e50c827 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:39.447376 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94ee7176-0c60-437e-ad7d-adc63e50c827 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:39.447806 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94ee7176-0c60-437e-ad7d-adc63e50c827 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:39.457069 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f9511fe9-20de-4fba-9306-50d301edf944 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:39.457986 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f9511fe9-20de-4fba-9306-50d301edf944 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:39.465888 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9511fe9-20de-4fba-9306-50d301edf944 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:39.466459 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9511fe9-20de-4fba-9306-50d301edf944 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:39.467493 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9511fe9-20de-4fba-9306-50d301edf944 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:39.468126 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9511fe9-20de-4fba-9306-50d301edf944 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:39.648844 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-94ee7176-0c60-437e-ad7d-adc63e50c827 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:39.658833 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-94ee7176-0c60-437e-ad7d-adc63e50c827 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.222822 Jun 26 03:05:39.659583 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 86/179] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:39 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:39.664115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f9511fe9-20de-4fba-9306-50d301edf944 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:39.671816 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f9511fe9-20de-4fba-9306-50d301edf944 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.219371 Jun 26 03:05:39.672582 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 94/180] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:39 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:39.800287 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-917d5c89-3245-4345-9db9-1d8c25c4c71e req-fd4b5e92-3fa0-4e75-9039-283d0a1ae270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b753d813-95df-4256-a8c0-dcd4681dfe27", "name": "network-vif-plugged", "status": "completed", "tag": "343e4080-88b4-47fd-8dd1-6b13277216f9"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:39.810508 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-917d5c89-3245-4345-9db9-1d8c25c4c71e req-fd4b5e92-3fa0-4e75-9039-283d0a1ae270 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:39.811120 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-917d5c89-3245-4345-9db9-1d8c25c4c71e req-fd4b5e92-3fa0-4e75-9039-283d0a1ae270 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:39.826007 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-917d5c89-3245-4345-9db9-1d8c25c4c71e req-fd4b5e92-3fa0-4e75-9039-283d0a1ae270 service nova] Creating event network-vif-plugged:343e4080-88b4-47fd-8dd1-6b13277216f9 for instance b753d813-95df-4256-a8c0-dcd4681dfe27 on hv-cinder-84684 Jun 26 03:05:39.834596 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-917d5c89-3245-4345-9db9-1d8c25c4c71e req-fd4b5e92-3fa0-4e75-9039-283d0a1ae270 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040019 Jun 26 03:05:39.835456 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 87/181] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:05:40.051769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-539eb8d1-5e4c-4ec9-8ef2-212530e062ca tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:40.052950 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-539eb8d1-5e4c-4ec9-8ef2-212530e062ca tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:40.059725 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-539eb8d1-5e4c-4ec9-8ef2-212530e062ca tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:40.060423 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-539eb8d1-5e4c-4ec9-8ef2-212530e062ca tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:40.061430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-539eb8d1-5e4c-4ec9-8ef2-212530e062ca tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:40.062649 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-539eb8d1-5e4c-4ec9-8ef2-212530e062ca tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:40.118227 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-40efe9db-7780-47e4-8ff3-2d92c3581400 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:40.119076 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-40efe9db-7780-47e4-8ff3-2d92c3581400 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:40.132901 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-40efe9db-7780-47e4-8ff3-2d92c3581400 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:40.133682 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-40efe9db-7780-47e4-8ff3-2d92c3581400 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:40.134790 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-40efe9db-7780-47e4-8ff3-2d92c3581400 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:40.135460 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-40efe9db-7780-47e4-8ff3-2d92c3581400 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:40.363574 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-539eb8d1-5e4c-4ec9-8ef2-212530e062ca tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:40.371755 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-539eb8d1-5e4c-4ec9-8ef2-212530e062ca tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:40.376142 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-40efe9db-7780-47e4-8ff3-2d92c3581400 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:40.380634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-539eb8d1-5e4c-4ec9-8ef2-212530e062ca tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:40.381795 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-539eb8d1-5e4c-4ec9-8ef2-212530e062ca tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.334371 Jun 26 03:05:40.382381 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 95/182] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:40 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:40.388243 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-40efe9db-7780-47e4-8ff3-2d92c3581400 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.276060 Jun 26 03:05:40.390694 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0f3e6f9b-77bb-4f47-b2f2-d37599b37412 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:40.391371 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0f3e6f9b-77bb-4f47-b2f2-d37599b37412 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:40.400215 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 88/183] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:40 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:40.401237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0f3e6f9b-77bb-4f47-b2f2-d37599b37412 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:40.401925 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0f3e6f9b-77bb-4f47-b2f2-d37599b37412 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:40.402888 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0f3e6f9b-77bb-4f47-b2f2-d37599b37412 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:40.403330 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0f3e6f9b-77bb-4f47-b2f2-d37599b37412 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:40.550928 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0f3e6f9b-77bb-4f47-b2f2-d37599b37412 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:40.560212 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0f3e6f9b-77bb-4f47-b2f2-d37599b37412 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.176028 Jun 26 03:05:40.560966 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 96/184] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:40 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:40.677446 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4e1ba199-0c9d-429f-bd0a-d6e9d61c4260 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:40.678341 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4e1ba199-0c9d-429f-bd0a-d6e9d61c4260 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:40.689013 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-59b68446-9f6f-4347-923a-d65f4f35102f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:40.689765 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-59b68446-9f6f-4347-923a-d65f4f35102f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:40.694797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4e1ba199-0c9d-429f-bd0a-d6e9d61c4260 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:40.698089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-59b68446-9f6f-4347-923a-d65f4f35102f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:40.698739 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4e1ba199-0c9d-429f-bd0a-d6e9d61c4260 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:40.699349 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-59b68446-9f6f-4347-923a-d65f4f35102f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:40.701722 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4e1ba199-0c9d-429f-bd0a-d6e9d61c4260 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:40.702115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-59b68446-9f6f-4347-923a-d65f4f35102f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:40.703102 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-59b68446-9f6f-4347-923a-d65f4f35102f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:40.703579 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4e1ba199-0c9d-429f-bd0a-d6e9d61c4260 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:41.057705 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4e1ba199-0c9d-429f-bd0a-d6e9d61c4260 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:41.066336 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4e1ba199-0c9d-429f-bd0a-d6e9d61c4260 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.392517 Jun 26 03:05:41.067288 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 89/185] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:40 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:41.067909 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-59b68446-9f6f-4347-923a-d65f4f35102f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:41.076316 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-59b68446-9f6f-4347-923a-d65f4f35102f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.392030 Jun 26 03:05:41.076884 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 97/186] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:40 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:41.404959 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-20baa875-7fbc-4c69-aa8f-c37e735ac10d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:41.406269 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8c77d4d8-727c-4467-b6b7-6a59ad4f82e0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:41.407108 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-20baa875-7fbc-4c69-aa8f-c37e735ac10d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:41.407913 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8c77d4d8-727c-4467-b6b7-6a59ad4f82e0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:41.420493 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-20baa875-7fbc-4c69-aa8f-c37e735ac10d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:41.422998 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8c77d4d8-727c-4467-b6b7-6a59ad4f82e0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:41.423768 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-20baa875-7fbc-4c69-aa8f-c37e735ac10d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:41.424607 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-20baa875-7fbc-4c69-aa8f-c37e735ac10d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:41.425229 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8c77d4d8-727c-4467-b6b7-6a59ad4f82e0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:41.426075 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8c77d4d8-727c-4467-b6b7-6a59ad4f82e0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:41.426483 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-20baa875-7fbc-4c69-aa8f-c37e735ac10d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:41.428687 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8c77d4d8-727c-4467-b6b7-6a59ad4f82e0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:41.460178 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=100 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:41.674142 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8c77d4d8-727c-4467-b6b7-6a59ad4f82e0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:41.679155 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-20baa875-7fbc-4c69-aa8f-c37e735ac10d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:41.685403 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8c77d4d8-727c-4467-b6b7-6a59ad4f82e0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:41.686602 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-20baa875-7fbc-4c69-aa8f-c37e735ac10d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.285913 Jun 26 03:05:41.688889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8c77d4d8-727c-4467-b6b7-6a59ad4f82e0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:41.690506 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8c77d4d8-727c-4467-b6b7-6a59ad4f82e0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.294279 Jun 26 03:05:41.691241 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 98/187] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:41 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:41.691845 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 90/188] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:41 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:05:41.706247 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-133f1e4a-e293-4aaf-b0a3-5aabf5d2f39c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:41.707970 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-133f1e4a-e293-4aaf-b0a3-5aabf5d2f39c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:41.714764 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-133f1e4a-e293-4aaf-b0a3-5aabf5d2f39c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:41.715452 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-133f1e4a-e293-4aaf-b0a3-5aabf5d2f39c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:41.716370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-133f1e4a-e293-4aaf-b0a3-5aabf5d2f39c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:41.717615 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-133f1e4a-e293-4aaf-b0a3-5aabf5d2f39c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:41.892830 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-f56a4121-460f-487a-ac92-f4181b939950 req-1bba27f5-eefa-4444-aafd-0aef09db36d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87611df-64cb-42cb-b734-782bf9ebb9ab", "name": "network-vif-plugged", "status": "completed", "tag": "964b9885-7663-4cc6-bfd4-5bb8f0e20bea"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:41.906691 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-f56a4121-460f-487a-ac92-f4181b939950 req-1bba27f5-eefa-4444-aafd-0aef09db36d5 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:41.907144 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-f56a4121-460f-487a-ac92-f4181b939950 req-1bba27f5-eefa-4444-aafd-0aef09db36d5 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:41.936282 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-f56a4121-460f-487a-ac92-f4181b939950 req-1bba27f5-eefa-4444-aafd-0aef09db36d5 service nova] Creating event network-vif-plugged:964b9885-7663-4cc6-bfd4-5bb8f0e20bea for instance d87611df-64cb-42cb-b734-782bf9ebb9ab on hv-cinder-84684 Jun 26 03:05:41.943475 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-f56a4121-460f-487a-ac92-f4181b939950 req-1bba27f5-eefa-4444-aafd-0aef09db36d5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053947 Jun 26 03:05:41.944636 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 91/189] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:05:41.972168 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-133f1e4a-e293-4aaf-b0a3-5aabf5d2f39c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:41.985578 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-133f1e4a-e293-4aaf-b0a3-5aabf5d2f39c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.280917 Jun 26 03:05:41.985578 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 99/190] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:41 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:42.089476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-bbfaea00-9634-4232-9004-a40b968e8ab0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:42.090892 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-bbfaea00-9634-4232-9004-a40b968e8ab0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:42.094941 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-97d3d1be-b079-4a1f-90b7-bb6e0306af59 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:42.095685 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-97d3d1be-b079-4a1f-90b7-bb6e0306af59 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:42.103718 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-97d3d1be-b079-4a1f-90b7-bb6e0306af59 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:42.108148 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-97d3d1be-b079-4a1f-90b7-bb6e0306af59 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:42.109886 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-97d3d1be-b079-4a1f-90b7-bb6e0306af59 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:42.110451 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-97d3d1be-b079-4a1f-90b7-bb6e0306af59 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:42.126844 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bbfaea00-9634-4232-9004-a40b968e8ab0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:42.127427 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bbfaea00-9634-4232-9004-a40b968e8ab0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:42.130277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bbfaea00-9634-4232-9004-a40b968e8ab0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:42.131533 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bbfaea00-9634-4232-9004-a40b968e8ab0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:42.412955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-bbfaea00-9634-4232-9004-a40b968e8ab0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:42.427415 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-97d3d1be-b079-4a1f-90b7-bb6e0306af59 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:42.431408 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-bbfaea00-9634-4232-9004-a40b968e8ab0 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.351924 Jun 26 03:05:42.432985 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 92/191] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:42 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:42.435824 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-97d3d1be-b079-4a1f-90b7-bb6e0306af59 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.346639 Jun 26 03:05:42.444568 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 100/192] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:42 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:42.709369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-0a9fd4b2-6a33-4a8e-834a-867c8361d3e2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:42.710825 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-71802ba0-fad8-472f-be44-c62e8b9f99bc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:42.711227 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-0a9fd4b2-6a33-4a8e-834a-867c8361d3e2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:42.712130 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-71802ba0-fad8-472f-be44-c62e8b9f99bc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:42.720387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0a9fd4b2-6a33-4a8e-834a-867c8361d3e2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:42.721217 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0a9fd4b2-6a33-4a8e-834a-867c8361d3e2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:42.723023 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0a9fd4b2-6a33-4a8e-834a-867c8361d3e2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:42.723810 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0a9fd4b2-6a33-4a8e-834a-867c8361d3e2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:42.731091 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-71802ba0-fad8-472f-be44-c62e8b9f99bc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:42.731540 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-71802ba0-fad8-472f-be44-c62e8b9f99bc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:42.732303 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-71802ba0-fad8-472f-be44-c62e8b9f99bc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:42.732736 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-71802ba0-fad8-472f-be44-c62e8b9f99bc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:42.934169 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-0a9fd4b2-6a33-4a8e-834a-867c8361d3e2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:42.941730 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-0a9fd4b2-6a33-4a8e-834a-867c8361d3e2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.240865 Jun 26 03:05:42.948602 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 93/193] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:42 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:42.987882 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-71802ba0-fad8-472f-be44-c62e8b9f99bc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:42.999998 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-0df482da-b3c2-4af4-84ba-c683949c8499 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:43.000912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-0df482da-b3c2-4af4-84ba-c683949c8499 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:43.006230 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-71802ba0-fad8-472f-be44-c62e8b9f99bc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:43.009975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0df482da-b3c2-4af4-84ba-c683949c8499 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:43.011771 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-71802ba0-fad8-472f-be44-c62e8b9f99bc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:43.012905 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-71802ba0-fad8-472f-be44-c62e8b9f99bc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.307364 Jun 26 03:05:43.013482 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0df482da-b3c2-4af4-84ba-c683949c8499 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:43.014670 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0df482da-b3c2-4af4-84ba-c683949c8499 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:43.015299 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0df482da-b3c2-4af4-84ba-c683949c8499 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:43.018210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 101/194] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:42 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:05:43.188970 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-0df482da-b3c2-4af4-84ba-c683949c8499 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:43.205409 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-0df482da-b3c2-4af4-84ba-c683949c8499 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.208927 Jun 26 03:05:43.206587 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 94/195] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:42 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:43.449339 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-94d3d5c0-5bab-41e7-bf8d-2a6c8234249a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:43.450757 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-94d3d5c0-5bab-41e7-bf8d-2a6c8234249a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:43.457035 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ae3f6db2-b0bd-4350-8655-b002a017d564 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:43.457708 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ae3f6db2-b0bd-4350-8655-b002a017d564 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:43.459404 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-94d3d5c0-5bab-41e7-bf8d-2a6c8234249a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:43.460105 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-94d3d5c0-5bab-41e7-bf8d-2a6c8234249a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:43.461100 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-94d3d5c0-5bab-41e7-bf8d-2a6c8234249a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:43.461744 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-94d3d5c0-5bab-41e7-bf8d-2a6c8234249a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:43.468881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ae3f6db2-b0bd-4350-8655-b002a017d564 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:43.468881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ae3f6db2-b0bd-4350-8655-b002a017d564 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:43.469214 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ae3f6db2-b0bd-4350-8655-b002a017d564 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:43.469879 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ae3f6db2-b0bd-4350-8655-b002a017d564 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:43.680770 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ae3f6db2-b0bd-4350-8655-b002a017d564 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:43.684861 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-94d3d5c0-5bab-41e7-bf8d-2a6c8234249a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:43.692992 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-94d3d5c0-5bab-41e7-bf8d-2a6c8234249a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.247595 Jun 26 03:05:43.695953 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ae3f6db2-b0bd-4350-8655-b002a017d564 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.245767 Jun 26 03:05:43.702844 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 102/196] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:43 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:43.703247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 95/197] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:43 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:43.965681 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6d0510a3-b26c-4bfb-995b-a9501aeb5aa4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:43.969581 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-6d0510a3-b26c-4bfb-995b-a9501aeb5aa4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:43.993260 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6d0510a3-b26c-4bfb-995b-a9501aeb5aa4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:43.994465 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6d0510a3-b26c-4bfb-995b-a9501aeb5aa4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:43.995769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6d0510a3-b26c-4bfb-995b-a9501aeb5aa4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:43.996436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6d0510a3-b26c-4bfb-995b-a9501aeb5aa4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:44.035842 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9dd26764-70fa-4f0a-b7de-983c0d0f4dd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:44.036449 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9dd26764-70fa-4f0a-b7de-983c0d0f4dd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:44.046538 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9dd26764-70fa-4f0a-b7de-983c0d0f4dd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:44.048546 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9dd26764-70fa-4f0a-b7de-983c0d0f4dd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:44.049538 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9dd26764-70fa-4f0a-b7de-983c0d0f4dd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:44.049977 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9dd26764-70fa-4f0a-b7de-983c0d0f4dd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:44.226457 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6d0510a3-b26c-4bfb-995b-a9501aeb5aa4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:44.245552 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6d0510a3-b26c-4bfb-995b-a9501aeb5aa4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.281662 Jun 26 03:05:44.247297 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 103/198] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:43 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:44.257206 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b8a222a7-5224-4a98-acf6-199ee3138f0c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:44.262424 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b8a222a7-5224-4a98-acf6-199ee3138f0c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:44.270795 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b8a222a7-5224-4a98-acf6-199ee3138f0c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:44.271925 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b8a222a7-5224-4a98-acf6-199ee3138f0c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:44.272999 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b8a222a7-5224-4a98-acf6-199ee3138f0c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:44.274235 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b8a222a7-5224-4a98-acf6-199ee3138f0c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:44.371537 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9dd26764-70fa-4f0a-b7de-983c0d0f4dd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:44.404926 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9dd26764-70fa-4f0a-b7de-983c0d0f4dd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:44.406945 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9dd26764-70fa-4f0a-b7de-983c0d0f4dd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:44.410723 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9dd26764-70fa-4f0a-b7de-983c0d0f4dd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1407 microversion: 2.20 time: 0.378092 Jun 26 03:05:44.411937 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 96/199] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:44 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1407 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:05:44.417630 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-3269ba41-8918-453d-abab-fb30c70c0842 req-c16974a6-1d0f-4a97-b52f-e54a241f4498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c55ca6d-bad0-4964-83fe-4352b7fb1b1d", "name": "network-vif-plugged", "status": "completed", "tag": "2d68efe6-d264-4cfb-8cd4-414d529eb007"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:44.433985 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-3269ba41-8918-453d-abab-fb30c70c0842 req-c16974a6-1d0f-4a97-b52f-e54a241f4498 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:44.435301 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-3269ba41-8918-453d-abab-fb30c70c0842 req-c16974a6-1d0f-4a97-b52f-e54a241f4498 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:44.452622 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-3269ba41-8918-453d-abab-fb30c70c0842 req-c16974a6-1d0f-4a97-b52f-e54a241f4498 service nova] Creating event network-vif-plugged:2d68efe6-d264-4cfb-8cd4-414d529eb007 for instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d on hv-cinder-84684 Jun 26 03:05:44.481796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-3269ba41-8918-453d-abab-fb30c70c0842 req-c16974a6-1d0f-4a97-b52f-e54a241f4498 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050683 Jun 26 03:05:44.483141 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 97/200] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:05:44.544923 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b8a222a7-5224-4a98-acf6-199ee3138f0c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:44.556434 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b8a222a7-5224-4a98-acf6-199ee3138f0c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.307087 Jun 26 03:05:44.557182 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 104/201] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:44 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:44.712885 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4c11915c-8c45-4567-a478-55c6845ab398 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:44.713987 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4c11915c-8c45-4567-a478-55c6845ab398 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:44.715696 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f04ac570-3f16-4a4d-8de9-74869d87d2d6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:44.718882 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f04ac570-3f16-4a4d-8de9-74869d87d2d6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:44.727523 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4c11915c-8c45-4567-a478-55c6845ab398 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:44.727993 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4c11915c-8c45-4567-a478-55c6845ab398 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:44.728777 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f04ac570-3f16-4a4d-8de9-74869d87d2d6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:44.728892 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4c11915c-8c45-4567-a478-55c6845ab398 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:44.729230 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f04ac570-3f16-4a4d-8de9-74869d87d2d6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:44.730066 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f04ac570-3f16-4a4d-8de9-74869d87d2d6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:44.731713 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4c11915c-8c45-4567-a478-55c6845ab398 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:44.734624 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f04ac570-3f16-4a4d-8de9-74869d87d2d6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:44.965216 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4c11915c-8c45-4567-a478-55c6845ab398 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:44.972633 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4c11915c-8c45-4567-a478-55c6845ab398 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.265407 Jun 26 03:05:44.982133 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 98/202] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:44 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:45.028636 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f04ac570-3f16-4a4d-8de9-74869d87d2d6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:45.038872 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f04ac570-3f16-4a4d-8de9-74869d87d2d6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.328633 Jun 26 03:05:45.039453 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 105/203] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:44 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:45.264832 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9e6a7caf-c6ba-4700-94cb-38bb0661e67c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:45.266259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9e6a7caf-c6ba-4700-94cb-38bb0661e67c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:45.272635 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9e6a7caf-c6ba-4700-94cb-38bb0661e67c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:45.273292 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9e6a7caf-c6ba-4700-94cb-38bb0661e67c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:45.275511 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9e6a7caf-c6ba-4700-94cb-38bb0661e67c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:45.276461 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9e6a7caf-c6ba-4700-94cb-38bb0661e67c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:45.284557 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=100 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:45.429205 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a0c9b728-ab7f-47c4-a231-a790f669bfb5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:45.429992 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a0c9b728-ab7f-47c4-a231-a790f669bfb5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:45.436975 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0c9b728-ab7f-47c4-a231-a790f669bfb5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:45.437624 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0c9b728-ab7f-47c4-a231-a790f669bfb5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:45.438700 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0c9b728-ab7f-47c4-a231-a790f669bfb5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:45.439333 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0c9b728-ab7f-47c4-a231-a790f669bfb5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:45.458284 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9e6a7caf-c6ba-4700-94cb-38bb0661e67c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:45.467617 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9e6a7caf-c6ba-4700-94cb-38bb0661e67c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.206298 Jun 26 03:05:45.477173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 99/204] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:45 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:45.574453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e04db7f7-d804-4b3f-b4eb-6568fd3778ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:45.575147 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e04db7f7-d804-4b3f-b4eb-6568fd3778ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:45.582473 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e04db7f7-d804-4b3f-b4eb-6568fd3778ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:45.582898 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e04db7f7-d804-4b3f-b4eb-6568fd3778ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:45.583661 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e04db7f7-d804-4b3f-b4eb-6568fd3778ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:45.584324 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e04db7f7-d804-4b3f-b4eb-6568fd3778ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:45.841830 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a0c9b728-ab7f-47c4-a231-a790f669bfb5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:45.853299 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a0c9b728-ab7f-47c4-a231-a790f669bfb5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:45.858337 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a0c9b728-ab7f-47c4-a231-a790f669bfb5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:45.860645 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a0c9b728-ab7f-47c4-a231-a790f669bfb5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1600 microversion: 2.20 time: 0.435269 Jun 26 03:05:45.861433 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 106/205] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:05:45 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1600 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:05:45.886435 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c480020f-7038-4883-b136-af469026718c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:45.887278 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c480020f-7038-4883-b136-af469026718c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:45.894484 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c480020f-7038-4883-b136-af469026718c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:45.895232 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c480020f-7038-4883-b136-af469026718c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:45.896009 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c480020f-7038-4883-b136-af469026718c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:45.896448 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c480020f-7038-4883-b136-af469026718c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:46.017817 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e04db7f7-d804-4b3f-b4eb-6568fd3778ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:46.026026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e04db7f7-d804-4b3f-b4eb-6568fd3778ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.455948 Jun 26 03:05:46.036133 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 100/206] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:45 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:46.036133 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-51dc86fa-6e42-451f-99a1-815ef8e2cc70 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:46.036133 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-51dc86fa-6e42-451f-99a1-815ef8e2cc70 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:46.039054 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c480020f-7038-4883-b136-af469026718c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.157628 Jun 26 03:05:46.039936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 107/207] 10.222.0.13 () {60 vars in 1315 bytes} [Sun Jun 26 03:05:45 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 03:05:46.040480 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-51dc86fa-6e42-451f-99a1-815ef8e2cc70 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:46.041125 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-51dc86fa-6e42-451f-99a1-815ef8e2cc70 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:46.042009 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-51dc86fa-6e42-451f-99a1-815ef8e2cc70 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:46.042556 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-51dc86fa-6e42-451f-99a1-815ef8e2cc70 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:46.056296 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-862a8395-517f-46ac-89bf-9d4dfc314c7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:46.056915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-862a8395-517f-46ac-89bf-9d4dfc314c7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:46.072715 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-862a8395-517f-46ac-89bf-9d4dfc314c7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:46.073173 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-862a8395-517f-46ac-89bf-9d4dfc314c7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:46.074082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-862a8395-517f-46ac-89bf-9d4dfc314c7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:46.074536 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-862a8395-517f-46ac-89bf-9d4dfc314c7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:46.277949 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-51dc86fa-6e42-451f-99a1-815ef8e2cc70 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:46.288191 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-51dc86fa-6e42-451f-99a1-815ef8e2cc70 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.259125 Jun 26 03:05:46.288985 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 101/208] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:46 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:46.328660 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-862a8395-517f-46ac-89bf-9d4dfc314c7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:46.339005 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-862a8395-517f-46ac-89bf-9d4dfc314c7c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.286624 Jun 26 03:05:46.339587 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 108/209] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:46 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:46.485648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-711e07ec-3a9a-41d4-aa95-d98169e5d319 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:46.486404 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-711e07ec-3a9a-41d4-aa95-d98169e5d319 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:46.495082 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-711e07ec-3a9a-41d4-aa95-d98169e5d319 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:46.495655 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-711e07ec-3a9a-41d4-aa95-d98169e5d319 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:46.496541 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-711e07ec-3a9a-41d4-aa95-d98169e5d319 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:46.497180 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-711e07ec-3a9a-41d4-aa95-d98169e5d319 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:46.782251 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-711e07ec-3a9a-41d4-aa95-d98169e5d319 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:46.794241 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-711e07ec-3a9a-41d4-aa95-d98169e5d319 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.313225 Jun 26 03:05:46.795121 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 102/210] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:46 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:47.045682 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e563aea0-f37d-45a5-80cc-65bf1f3e0486 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:47.047994 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e563aea0-f37d-45a5-80cc-65bf1f3e0486 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:47.054916 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e563aea0-f37d-45a5-80cc-65bf1f3e0486 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:47.055661 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e563aea0-f37d-45a5-80cc-65bf1f3e0486 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:47.056633 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e563aea0-f37d-45a5-80cc-65bf1f3e0486 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:47.057320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e563aea0-f37d-45a5-80cc-65bf1f3e0486 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:47.216178 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e563aea0-f37d-45a5-80cc-65bf1f3e0486 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:47.225415 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e563aea0-f37d-45a5-80cc-65bf1f3e0486 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.184887 Jun 26 03:05:47.226531 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 109/211] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:47 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:47.305091 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3ba9d97e-5dd7-4103-a9b0-30aec745f277 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:47.305608 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3ba9d97e-5dd7-4103-a9b0-30aec745f277 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:47.311916 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3ba9d97e-5dd7-4103-a9b0-30aec745f277 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:47.312367 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3ba9d97e-5dd7-4103-a9b0-30aec745f277 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:47.313134 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3ba9d97e-5dd7-4103-a9b0-30aec745f277 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:47.313807 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3ba9d97e-5dd7-4103-a9b0-30aec745f277 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:47.357097 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b122fe68-6f3f-4241-af39-deeac2a9e506 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:47.357955 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b122fe68-6f3f-4241-af39-deeac2a9e506 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:47.371813 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b122fe68-6f3f-4241-af39-deeac2a9e506 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:47.374483 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b122fe68-6f3f-4241-af39-deeac2a9e506 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:47.375527 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b122fe68-6f3f-4241-af39-deeac2a9e506 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:47.375991 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b122fe68-6f3f-4241-af39-deeac2a9e506 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:47.583759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-3ba9d97e-5dd7-4103-a9b0-30aec745f277 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:47.592192 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3ba9d97e-5dd7-4103-a9b0-30aec745f277 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.290306 Jun 26 03:05:47.593815 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 103/212] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:47 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:47.602681 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b122fe68-6f3f-4241-af39-deeac2a9e506 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:47.612072 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b122fe68-6f3f-4241-af39-deeac2a9e506 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.259855 Jun 26 03:05:47.612657 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 110/213] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:47 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:47.728038 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-194f2341-8916-4efa-8833-97703fdd17a6 req-71fcfa60-2c81-48cb-a63b-2decd61b7e8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0d1d9b-d025-442c-a2f6-db22050d9059", "tag": "52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:47.736944 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-194f2341-8916-4efa-8833-97703fdd17a6 req-71fcfa60-2c81-48cb-a63b-2decd61b7e8d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:47.737395 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-194f2341-8916-4efa-8833-97703fdd17a6 req-71fcfa60-2c81-48cb-a63b-2decd61b7e8d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:47.750002 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-194f2341-8916-4efa-8833-97703fdd17a6 req-71fcfa60-2c81-48cb-a63b-2decd61b7e8d service nova] Creating event network-changed:52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f for instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 on hv-cinder-84684 Jun 26 03:05:47.754797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-194f2341-8916-4efa-8833-97703fdd17a6 req-71fcfa60-2c81-48cb-a63b-2decd61b7e8d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030416 Jun 26 03:05:47.755393 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 104/214] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:05:47.810970 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8c3e4c3c-ac00-45de-8b91-25b2f775b52d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:47.811696 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8c3e4c3c-ac00-45de-8b91-25b2f775b52d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:47.818234 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8c3e4c3c-ac00-45de-8b91-25b2f775b52d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:47.825855 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8c3e4c3c-ac00-45de-8b91-25b2f775b52d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:47.826843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8c3e4c3c-ac00-45de-8b91-25b2f775b52d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:47.827358 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8c3e4c3c-ac00-45de-8b91-25b2f775b52d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:47.979761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-8c3e4c3c-ac00-45de-8b91-25b2f775b52d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:47.993495 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8c3e4c3c-ac00-45de-8b91-25b2f775b52d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.186523 Jun 26 03:05:47.997789 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 111/215] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:47 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:48.215932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-5fd4558e-9978-4de1-b34f-677e547669c7 req-28ad24b0-3cc5-4814-8e99-5708f2d4b28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a", "name": "network-vif-plugged", "status": "completed", "tag": "d9366ecd-7ca4-4109-bdc7-b47e7cb83078"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:48.227480 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-5fd4558e-9978-4de1-b34f-677e547669c7 req-28ad24b0-3cc5-4814-8e99-5708f2d4b28f service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:48.228236 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-5fd4558e-9978-4de1-b34f-677e547669c7 req-28ad24b0-3cc5-4814-8e99-5708f2d4b28f service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:48.244253 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-5fd4558e-9978-4de1-b34f-677e547669c7 req-28ad24b0-3cc5-4814-8e99-5708f2d4b28f service nova] Creating event network-vif-plugged:d9366ecd-7ca4-4109-bdc7-b47e7cb83078 for instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a on hv-cinder-84684 Jun 26 03:05:48.244405 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1b9e52d1-2d87-4490-9f67-23b77ff90a50 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:48.244950 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1b9e52d1-2d87-4490-9f67-23b77ff90a50 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:48.252357 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-5fd4558e-9978-4de1-b34f-677e547669c7 req-28ad24b0-3cc5-4814-8e99-5708f2d4b28f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041200 Jun 26 03:05:48.253848 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 105/216] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:05:48.257499 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1b9e52d1-2d87-4490-9f67-23b77ff90a50 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:48.258061 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1b9e52d1-2d87-4490-9f67-23b77ff90a50 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:48.259185 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1b9e52d1-2d87-4490-9f67-23b77ff90a50 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:48.260763 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1b9e52d1-2d87-4490-9f67-23b77ff90a50 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:48.438244 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1b9e52d1-2d87-4490-9f67-23b77ff90a50 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:48.446389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1b9e52d1-2d87-4490-9f67-23b77ff90a50 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.207145 Jun 26 03:05:48.447222 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 112/217] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:48 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:48.610548 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c97f11c6-5f3a-44ae-bf38-035cf64f3683 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:48.613885 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c97f11c6-5f3a-44ae-bf38-035cf64f3683 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:48.620604 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c97f11c6-5f3a-44ae-bf38-035cf64f3683 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:48.624375 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c97f11c6-5f3a-44ae-bf38-035cf64f3683 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:48.626086 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c97f11c6-5f3a-44ae-bf38-035cf64f3683 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:48.628832 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c97f11c6-5f3a-44ae-bf38-035cf64f3683 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:48.630488 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3d587447-6944-4079-bf08-30b0dc29ead3 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:48.631251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3d587447-6944-4079-bf08-30b0dc29ead3 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:48.644230 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3d587447-6944-4079-bf08-30b0dc29ead3 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:48.644689 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3d587447-6944-4079-bf08-30b0dc29ead3 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:48.649973 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3d587447-6944-4079-bf08-30b0dc29ead3 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:48.650515 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3d587447-6944-4079-bf08-30b0dc29ead3 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:48.961077 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3d587447-6944-4079-bf08-30b0dc29ead3 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:48.984799 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3d587447-6944-4079-bf08-30b0dc29ead3 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.356986 Jun 26 03:05:48.985606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 113/218] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:48 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:48.992222 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c97f11c6-5f3a-44ae-bf38-035cf64f3683 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:49.000546 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c97f11c6-5f3a-44ae-bf38-035cf64f3683 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.394792 Jun 26 03:05:49.001734 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 106/219] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:48 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:49.016607 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-5a33dc4c-e663-4414-b13e-c12c3e84f487 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:49.019052 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-5a33dc4c-e663-4414-b13e-c12c3e84f487 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:49.027513 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5a33dc4c-e663-4414-b13e-c12c3e84f487 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:49.028208 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5a33dc4c-e663-4414-b13e-c12c3e84f487 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:49.029024 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5a33dc4c-e663-4414-b13e-c12c3e84f487 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:49.029474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5a33dc4c-e663-4414-b13e-c12c3e84f487 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:49.203452 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-5a33dc4c-e663-4414-b13e-c12c3e84f487 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:49.229525 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-5a33dc4c-e663-4414-b13e-c12c3e84f487 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1363 microversion: 2.1 time: 0.220473 Jun 26 03:05:49.231607 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 114/220] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:49 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:49.463406 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-026ca08a-96ed-43de-88c1-84efa53d1ec1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:49.464022 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-026ca08a-96ed-43de-88c1-84efa53d1ec1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:49.472150 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-026ca08a-96ed-43de-88c1-84efa53d1ec1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:49.473214 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-026ca08a-96ed-43de-88c1-84efa53d1ec1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:49.476327 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-026ca08a-96ed-43de-88c1-84efa53d1ec1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:49.477097 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-026ca08a-96ed-43de-88c1-84efa53d1ec1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:49.712441 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-026ca08a-96ed-43de-88c1-84efa53d1ec1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:49.720826 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-026ca08a-96ed-43de-88c1-84efa53d1ec1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1321 microversion: 2.1 time: 0.261246 Jun 26 03:05:49.730345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 107/221] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:49 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:50.003467 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1c7ba378-6fa7-4a5b-aff0-fe79e648b667 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:50.004079 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1c7ba378-6fa7-4a5b-aff0-fe79e648b667 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:50.011046 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1c7ba378-6fa7-4a5b-aff0-fe79e648b667 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:50.011483 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1c7ba378-6fa7-4a5b-aff0-fe79e648b667 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:50.012408 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1c7ba378-6fa7-4a5b-aff0-fe79e648b667 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:50.012824 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1c7ba378-6fa7-4a5b-aff0-fe79e648b667 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:50.025202 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-55f04838-0742-4822-bf44-aa0fbe8692f6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:50.026364 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-55f04838-0742-4822-bf44-aa0fbe8692f6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:50.035275 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-55f04838-0742-4822-bf44-aa0fbe8692f6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:50.036125 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-55f04838-0742-4822-bf44-aa0fbe8692f6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:50.037882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-55f04838-0742-4822-bf44-aa0fbe8692f6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:50.038590 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-55f04838-0742-4822-bf44-aa0fbe8692f6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:50.041414 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=100 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:50.287501 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1c7ba378-6fa7-4a5b-aff0-fe79e648b667 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:50.298327 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1c7ba378-6fa7-4a5b-aff0-fe79e648b667 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1366 microversion: 2.1 time: 0.300267 Jun 26 03:05:50.302180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 115/222] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:49 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:50.309541 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9bc3df89-7033-4893-ace4-f454015e28f3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:50.310804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9bc3df89-7033-4893-ace4-f454015e28f3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:50.339986 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9bc3df89-7033-4893-ace4-f454015e28f3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:50.340439 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9bc3df89-7033-4893-ace4-f454015e28f3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:50.346488 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9bc3df89-7033-4893-ace4-f454015e28f3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:50.347129 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9bc3df89-7033-4893-ace4-f454015e28f3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:50.635133 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-55f04838-0742-4822-bf44-aa0fbe8692f6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:50.643191 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-55f04838-0742-4822-bf44-aa0fbe8692f6 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.625974 Jun 26 03:05:50.643684 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 108/223] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:50 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:50.653238 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9bc3df89-7033-4893-ace4-f454015e28f3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:50.661606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9bc3df89-7033-4893-ace4-f454015e28f3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1550 microversion: 2.1 time: 0.357002 Jun 26 03:05:50.682022 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a04f9db5-0bb8-4669-a592-c53388315ff0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:50.682582 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a04f9db5-0bb8-4669-a592-c53388315ff0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:50.687156 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 116/224] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:50 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1550 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:50.691008 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a04f9db5-0bb8-4669-a592-c53388315ff0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:50.691830 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a04f9db5-0bb8-4669-a592-c53388315ff0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:50.693038 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a04f9db5-0bb8-4669-a592-c53388315ff0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:50.693628 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a04f9db5-0bb8-4669-a592-c53388315ff0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:50.737347 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-72bc28b2-7fd1-4ac7-845a-29869080c05d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:50.737967 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-72bc28b2-7fd1-4ac7-845a-29869080c05d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:50.744524 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-72bc28b2-7fd1-4ac7-845a-29869080c05d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:50.746001 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-72bc28b2-7fd1-4ac7-845a-29869080c05d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:50.747755 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-72bc28b2-7fd1-4ac7-845a-29869080c05d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:50.748593 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-72bc28b2-7fd1-4ac7-845a-29869080c05d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:51.099638 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a04f9db5-0bb8-4669-a592-c53388315ff0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.424174 Jun 26 03:05:51.106235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 109/225] 10.222.0.13 () {58 vars in 1274 bytes} [Sun Jun 26 03:05:50 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/os-interface => generated 285 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:05:51.146685 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-72bc28b2-7fd1-4ac7-845a-29869080c05d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:51.155224 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-72bc28b2-7fd1-4ac7-845a-29869080c05d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1515 microversion: 2.1 time: 0.421453 Jun 26 03:05:51.156170 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 117/226] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:50 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1515 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:51.173186 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b55ea55a-fdf5-4eb4-8765-a3d5333402e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:51.174172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b55ea55a-fdf5-4eb4-8765-a3d5333402e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:51.180287 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b55ea55a-fdf5-4eb4-8765-a3d5333402e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:51.180739 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b55ea55a-fdf5-4eb4-8765-a3d5333402e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:51.181511 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b55ea55a-fdf5-4eb4-8765-a3d5333402e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:51.181955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b55ea55a-fdf5-4eb4-8765-a3d5333402e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:51.208975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-b55ea55a-fdf5-4eb4-8765-a3d5333402e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lazy-loading 'flavor' on Instance uuid b753d813-95df-4256-a8c0-dcd4681dfe27 {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:05:51.321107 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-752ca5b2-7a24-4bc0-a54c-c5a779ce1bfe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:51.322023 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-752ca5b2-7a24-4bc0-a54c-c5a779ce1bfe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:51.331749 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-752ca5b2-7a24-4bc0-a54c-c5a779ce1bfe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:51.334445 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-752ca5b2-7a24-4bc0-a54c-c5a779ce1bfe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:51.337931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-752ca5b2-7a24-4bc0-a54c-c5a779ce1bfe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:51.338638 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-752ca5b2-7a24-4bc0-a54c-c5a779ce1bfe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:51.349530 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b55ea55a-fdf5-4eb4-8765-a3d5333402e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "POST /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27/action" status: 200 len: 32 microversion: 2.1 time: 0.180249 Jun 26 03:05:51.354732 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 110/227] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:05:51 2022] POST /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 26 03:05:51.362439 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2293e5fd-88b5-41b7-a5bf-f2ba482a4759 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:51.363151 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2293e5fd-88b5-41b7-a5bf-f2ba482a4759 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:51.369344 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2293e5fd-88b5-41b7-a5bf-f2ba482a4759 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:51.369799 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2293e5fd-88b5-41b7-a5bf-f2ba482a4759 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:51.370591 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2293e5fd-88b5-41b7-a5bf-f2ba482a4759 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:51.371734 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2293e5fd-88b5-41b7-a5bf-f2ba482a4759 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:51.723671 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-752ca5b2-7a24-4bc0-a54c-c5a779ce1bfe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:51.734825 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-752ca5b2-7a24-4bc0-a54c-c5a779ce1bfe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1555 microversion: 2.1 time: 0.417984 Jun 26 03:05:51.736462 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 118/228] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:51 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1555 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:51.738648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2293e5fd-88b5-41b7-a5bf-f2ba482a4759 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:51.743610 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a5188b6f-3cdb-4e1f-b921-3c2ab934c489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:51.744417 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a5188b6f-3cdb-4e1f-b921-3c2ab934c489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:51.746339 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2293e5fd-88b5-41b7-a5bf-f2ba482a4759 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.390349 Jun 26 03:05:51.746901 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 111/229] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:51 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:51.752723 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a5188b6f-3cdb-4e1f-b921-3c2ab934c489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:51.753765 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a5188b6f-3cdb-4e1f-b921-3c2ab934c489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:51.754385 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-39dc3e03-e8e6-4b0c-ab7b-23df0c6cfa28 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:51.754876 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-39dc3e03-e8e6-4b0c-ab7b-23df0c6cfa28 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:51.754982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a5188b6f-3cdb-4e1f-b921-3c2ab934c489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:51.755318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a5188b6f-3cdb-4e1f-b921-3c2ab934c489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:51.761307 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-39dc3e03-e8e6-4b0c-ab7b-23df0c6cfa28 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:51.762165 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-39dc3e03-e8e6-4b0c-ab7b-23df0c6cfa28 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:51.763180 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-39dc3e03-e8e6-4b0c-ab7b-23df0c6cfa28 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:51.763763 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-39dc3e03-e8e6-4b0c-ab7b-23df0c6cfa28 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:51.891619 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-39dc3e03-e8e6-4b0c-ab7b-23df0c6cfa28 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142556 Jun 26 03:05:51.897808 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 112/230] 10.222.0.13 () {58 vars in 1274 bytes} [Sun Jun 26 03:05:51 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:05:51.981226 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a5188b6f-3cdb-4e1f-b921-3c2ab934c489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:51.990160 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a5188b6f-3cdb-4e1f-b921-3c2ab934c489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.252366 Jun 26 03:05:52.001665 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 119/231] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:51 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:52.764599 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a8051634-3eb5-4049-bcff-2e7c4a05cc5d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:52.765237 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a8051634-3eb5-4049-bcff-2e7c4a05cc5d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:52.769636 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=100 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:52.784839 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a8051634-3eb5-4049-bcff-2e7c4a05cc5d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:52.785295 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a8051634-3eb5-4049-bcff-2e7c4a05cc5d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:52.786094 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a8051634-3eb5-4049-bcff-2e7c4a05cc5d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:52.786535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a8051634-3eb5-4049-bcff-2e7c4a05cc5d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:53.013056 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0d6ede39-11ba-4c13-ba48-fd822cbff049 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:53.015723 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0d6ede39-11ba-4c13-ba48-fd822cbff049 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:53.034834 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0d6ede39-11ba-4c13-ba48-fd822cbff049 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:53.038080 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0d6ede39-11ba-4c13-ba48-fd822cbff049 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:53.042820 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0d6ede39-11ba-4c13-ba48-fd822cbff049 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:53.044042 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0d6ede39-11ba-4c13-ba48-fd822cbff049 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:53.058763 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a8051634-3eb5-4049-bcff-2e7c4a05cc5d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:53.068859 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a8051634-3eb5-4049-bcff-2e7c4a05cc5d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.308128 Jun 26 03:05:53.069696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 113/232] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:52 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:53.379963 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0d6ede39-11ba-4c13-ba48-fd822cbff049 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:53.392107 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0d6ede39-11ba-4c13-ba48-fd822cbff049 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1314 microversion: 2.1 time: 0.385505 Jun 26 03:05:53.393136 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 120/233] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:53 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:53.978463 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-18f8a0de-97f5-4d1b-a91e-b1534aa4fac7 req-57ca5385-e13c-451f-bcb3-eeeaf9cc87fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c55ca6d-bad0-4964-83fe-4352b7fb1b1d", "tag": "2d68efe6-d264-4cfb-8cd4-414d529eb007"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:53.991352 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-18f8a0de-97f5-4d1b-a91e-b1534aa4fac7 req-57ca5385-e13c-451f-bcb3-eeeaf9cc87fe service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:53.991926 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-18f8a0de-97f5-4d1b-a91e-b1534aa4fac7 req-57ca5385-e13c-451f-bcb3-eeeaf9cc87fe service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:54.005349 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-18f8a0de-97f5-4d1b-a91e-b1534aa4fac7 req-57ca5385-e13c-451f-bcb3-eeeaf9cc87fe service nova] Creating event network-changed:2d68efe6-d264-4cfb-8cd4-414d529eb007 for instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d on hv-cinder-84684 Jun 26 03:05:54.011144 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-18f8a0de-97f5-4d1b-a91e-b1534aa4fac7 req-57ca5385-e13c-451f-bcb3-eeeaf9cc87fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037915 Jun 26 03:05:54.012255 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 114/234] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:05:54.087262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-82d436e2-37d2-4ce8-bc7a-6694c7caf099 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:54.088848 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-82d436e2-37d2-4ce8-bc7a-6694c7caf099 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:54.102426 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-82d436e2-37d2-4ce8-bc7a-6694c7caf099 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:54.102905 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-82d436e2-37d2-4ce8-bc7a-6694c7caf099 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:54.103715 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-82d436e2-37d2-4ce8-bc7a-6694c7caf099 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:54.104162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-82d436e2-37d2-4ce8-bc7a-6694c7caf099 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:54.377333 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-82d436e2-37d2-4ce8-bc7a-6694c7caf099 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:54.396146 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-82d436e2-37d2-4ce8-bc7a-6694c7caf099 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.312984 Jun 26 03:05:54.398411 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 121/235] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:54 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:54.413616 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-53432a36-7acb-41cd-ac9d-632e9f3461a5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:54.415001 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-53432a36-7acb-41cd-ac9d-632e9f3461a5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:54.425459 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-53432a36-7acb-41cd-ac9d-632e9f3461a5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:54.429962 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-53432a36-7acb-41cd-ac9d-632e9f3461a5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:54.430832 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-53432a36-7acb-41cd-ac9d-632e9f3461a5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:54.431285 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-53432a36-7acb-41cd-ac9d-632e9f3461a5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:54.943856 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-53432a36-7acb-41cd-ac9d-632e9f3461a5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:54.969044 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-53432a36-7acb-41cd-ac9d-632e9f3461a5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1501 microversion: 2.1 time: 0.561671 Jun 26 03:05:54.977317 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 115/236] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:54 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1501 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:55.419607 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4bb6d7c6-25bb-4337-b37b-932b999cc8d7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:55.420874 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4bb6d7c6-25bb-4337-b37b-932b999cc8d7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:55.435823 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4bb6d7c6-25bb-4337-b37b-932b999cc8d7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:55.436502 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4bb6d7c6-25bb-4337-b37b-932b999cc8d7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:55.437960 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4bb6d7c6-25bb-4337-b37b-932b999cc8d7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:55.438634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4bb6d7c6-25bb-4337-b37b-932b999cc8d7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:55.688975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1660082033", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "networks": [{"uuid": "db8ad85e-89b6-4916-ae2f-7389fbc85f35"}]}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:55.775587 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.network.neutron [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] validate_networks() for [('db8ad85e-89b6-4916-ae2f-7389fbc85f35', None, None, None, None, None)] {{(pid=117782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:05:56.225360 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4bb6d7c6-25bb-4337-b37b-932b999cc8d7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:56.239058 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4bb6d7c6-25bb-4337-b37b-932b999cc8d7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.827308 Jun 26 03:05:56.258318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 122/237] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:55 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:56.276845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-bb4e92ed-0050-4696-819e-78bdea24400e req-54289655-344c-4c9e-8582-1958e95510be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87611df-64cb-42cb-b734-782bf9ebb9ab", "tag": "964b9885-7663-4cc6-bfd4-5bb8f0e20bea"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:56.296753 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-bb4e92ed-0050-4696-819e-78bdea24400e req-54289655-344c-4c9e-8582-1958e95510be service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:56.298109 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-bb4e92ed-0050-4696-819e-78bdea24400e req-54289655-344c-4c9e-8582-1958e95510be service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:56.323283 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-bb4e92ed-0050-4696-819e-78bdea24400e req-54289655-344c-4c9e-8582-1958e95510be service nova] Creating event network-changed:964b9885-7663-4cc6-bfd4-5bb8f0e20bea for instance d87611df-64cb-42cb-b734-782bf9ebb9ab on hv-cinder-84684 Jun 26 03:05:56.331411 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-bb4e92ed-0050-4696-819e-78bdea24400e req-54289655-344c-4c9e-8582-1958e95510be service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071564 Jun 26 03:05:56.335200 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 123/238] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:05:56.674595 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2dfcda94-81de-4df2-9e9e-8c5218d05ae9 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a5c979d-175e-43f8-bfd3-9d5457bf6e47"}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:05:56.676723 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2dfcda94-81de-4df2-9e9e-8c5218d05ae9 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:56.685788 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2dfcda94-81de-4df2-9e9e-8c5218d05ae9 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:56.687656 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2dfcda94-81de-4df2-9e9e-8c5218d05ae9 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:56.689069 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2dfcda94-81de-4df2-9e9e-8c5218d05ae9 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:56.689995 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2dfcda94-81de-4df2-9e9e-8c5218d05ae9 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:56.891823 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Flavor limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:05:56.892314 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Image limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:05:56.892718 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Flavor pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:05:56.893124 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Image pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:05:56.893536 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:05:56.906648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:56.907098 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:56.907897 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:56.908331 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:56.954431 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Getting quotas for project 5db904f456b040d8a9f16b169118d21a. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:05:56.961031 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Getting quotas for user c31dbb3dcd9a411ea125573c8189e00c and project 5db904f456b040d8a9f16b169118d21a. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:05:56.976767 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Going to run 1 instances... {{(pid=117782) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:05:56.979846 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:05:57.086486 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2ed95fff-6388-4bee-a2b6-fd0976d3df70 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402948 Jun 26 03:05:57.090200 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 116/239] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:05:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 26 03:05:57.111946 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a3c0d45a-4d2e-4d0d-aff6-b8ca462f4fd4 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:57.112757 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a3c0d45a-4d2e-4d0d-aff6-b8ca462f4fd4 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:57.123363 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2dfcda94-81de-4df2-9e9e-8c5218d05ae9 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "POST /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454080 Jun 26 03:05:57.124325 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 124/240] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:05:56 2022] POST /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a/os-volume_attachments => generated 194 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:05:57.277755 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a3c0d45a-4d2e-4d0d-aff6-b8ca462f4fd4 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:57.284578 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-57235af4-f144-413c-ab26-5be90290d361 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:57.285414 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-57235af4-f144-413c-ab26-5be90290d361 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:57.288379 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a3c0d45a-4d2e-4d0d-aff6-b8ca462f4fd4 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1214 microversion: 2.1 time: 0.186724 Jun 26 03:05:57.300799 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 117/241] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:57 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:57.304394 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-57235af4-f144-413c-ab26-5be90290d361 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:57.305052 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-57235af4-f144-413c-ab26-5be90290d361 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:57.306682 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-57235af4-f144-413c-ab26-5be90290d361 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:57.308463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-57235af4-f144-413c-ab26-5be90290d361 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:57.565669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-57235af4-f144-413c-ab26-5be90290d361 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:57.580003 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-57235af4-f144-413c-ab26-5be90290d361 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.310367 Jun 26 03:05:57.593953 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 125/242] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:57 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:05:58.311785 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-36224045-7bce-4c12-a495-d7f5260e062a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:58.312480 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-36224045-7bce-4c12-a495-d7f5260e062a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:58.320170 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-36224045-7bce-4c12-a495-d7f5260e062a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:58.326573 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-36224045-7bce-4c12-a495-d7f5260e062a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:58.327956 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-36224045-7bce-4c12-a495-d7f5260e062a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:58.328332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-36224045-7bce-4c12-a495-d7f5260e062a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:58.334638 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:58.395398 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-36224045-7bce-4c12-a495-d7f5260e062a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:58.406229 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-36224045-7bce-4c12-a495-d7f5260e062a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1266 microversion: 2.1 time: 0.103832 Jun 26 03:05:58.416096 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 118/243] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:58 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:58.600054 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9e96d3fa-d3b0-4763-b12d-01032e2d0c92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:58.601283 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9e96d3fa-d3b0-4763-b12d-01032e2d0c92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:58.610404 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9e96d3fa-d3b0-4763-b12d-01032e2d0c92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:58.610861 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9e96d3fa-d3b0-4763-b12d-01032e2d0c92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:58.611626 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9e96d3fa-d3b0-4763-b12d-01032e2d0c92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:58.612064 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9e96d3fa-d3b0-4763-b12d-01032e2d0c92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:58.757353 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9e96d3fa-d3b0-4763-b12d-01032e2d0c92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:58.765446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9e96d3fa-d3b0-4763-b12d-01032e2d0c92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.169634 Jun 26 03:05:58.766012 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 126/244] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:58 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:59.427543 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-70c48a99-e3a0-4db6-898b-e34db381fb0f tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:59.428436 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-70c48a99-e3a0-4db6-898b-e34db381fb0f tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:59.435222 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70c48a99-e3a0-4db6-898b-e34db381fb0f tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:59.435909 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70c48a99-e3a0-4db6-898b-e34db381fb0f tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:59.437368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70c48a99-e3a0-4db6-898b-e34db381fb0f tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:59.437774 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70c48a99-e3a0-4db6-898b-e34db381fb0f tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:59.633323 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-70c48a99-e3a0-4db6-898b-e34db381fb0f tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:05:59.652283 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-70c48a99-e3a0-4db6-898b-e34db381fb0f tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.231992 Jun 26 03:05:59.665194 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 119/245] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:59 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:05:59.787394 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d92189fa-5ef3-4d6a-9a2e-bc20404abeb3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:05:59.789563 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d92189fa-5ef3-4d6a-9a2e-bc20404abeb3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:05:59.800451 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d92189fa-5ef3-4d6a-9a2e-bc20404abeb3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:59.801161 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d92189fa-5ef3-4d6a-9a2e-bc20404abeb3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:05:59.802706 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d92189fa-5ef3-4d6a-9a2e-bc20404abeb3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:05:59.803159 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d92189fa-5ef3-4d6a-9a2e-bc20404abeb3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:00.023435 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d92189fa-5ef3-4d6a-9a2e-bc20404abeb3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:00.032511 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d92189fa-5ef3-4d6a-9a2e-bc20404abeb3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.253191 Jun 26 03:06:00.033392 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 127/246] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:05:59 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:00.464662 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-ff3a76b4-b440-4540-904f-8b469e16e1ad req-0ee81e09-e94b-4c14-80f7-03066507697f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "690029c3-471e-45f0-899e-3f57c61ca236", "tag": "71302763-1081-4376-b087-f298db36489e"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:06:00.475550 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-ff3a76b4-b440-4540-904f-8b469e16e1ad req-0ee81e09-e94b-4c14-80f7-03066507697f service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:00.476173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-ff3a76b4-b440-4540-904f-8b469e16e1ad req-0ee81e09-e94b-4c14-80f7-03066507697f service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:00.487540 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-ff3a76b4-b440-4540-904f-8b469e16e1ad req-0ee81e09-e94b-4c14-80f7-03066507697f service nova] Creating event network-changed:71302763-1081-4376-b087-f298db36489e for instance 690029c3-471e-45f0-899e-3f57c61ca236 on hv-cinder-84684 Jun 26 03:06:00.492401 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-ff3a76b4-b440-4540-904f-8b469e16e1ad req-0ee81e09-e94b-4c14-80f7-03066507697f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032120 Jun 26 03:06:00.492980 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 120/247] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:06:00.668880 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-760268d8-b891-425a-a0d4-6a052c60e284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:00.669600 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-760268d8-b891-425a-a0d4-6a052c60e284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:00.676165 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-760268d8-b891-425a-a0d4-6a052c60e284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:00.676614 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-760268d8-b891-425a-a0d4-6a052c60e284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:00.677381 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-760268d8-b891-425a-a0d4-6a052c60e284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:00.677822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-760268d8-b891-425a-a0d4-6a052c60e284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:00.811182 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-760268d8-b891-425a-a0d4-6a052c60e284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:00.819484 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-760268d8-b891-425a-a0d4-6a052c60e284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.154474 Jun 26 03:06:00.820144 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 128/248] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:00 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:01.049592 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ea121c1b-721a-45fb-a1c1-69bd8a5603f2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:01.050324 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ea121c1b-721a-45fb-a1c1-69bd8a5603f2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:01.056368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ea121c1b-721a-45fb-a1c1-69bd8a5603f2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:01.056825 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ea121c1b-721a-45fb-a1c1-69bd8a5603f2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:01.057652 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ea121c1b-721a-45fb-a1c1-69bd8a5603f2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:01.058006 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ea121c1b-721a-45fb-a1c1-69bd8a5603f2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:01.223498 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ea121c1b-721a-45fb-a1c1-69bd8a5603f2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:01.230882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ea121c1b-721a-45fb-a1c1-69bd8a5603f2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.185403 Jun 26 03:06:01.231452 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 121/249] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:01 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:01.837459 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-74252661-e83f-4fb1-af40-05ca7798ebb6 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:01.838220 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-74252661-e83f-4fb1-af40-05ca7798ebb6 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:01.845346 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-74252661-e83f-4fb1-af40-05ca7798ebb6 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:01.846082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-74252661-e83f-4fb1-af40-05ca7798ebb6 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:01.846873 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-74252661-e83f-4fb1-af40-05ca7798ebb6 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:01.847320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-74252661-e83f-4fb1-af40-05ca7798ebb6 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:02.024771 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-74252661-e83f-4fb1-af40-05ca7798ebb6 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:02.032541 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-74252661-e83f-4fb1-af40-05ca7798ebb6 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.199432 Jun 26 03:06:02.033101 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 129/250] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:01 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:02.248053 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2ca75e92-f0e9-4d9c-b519-3f2f05e64f74 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:02.248702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2ca75e92-f0e9-4d9c-b519-3f2f05e64f74 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:02.255830 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2ca75e92-f0e9-4d9c-b519-3f2f05e64f74 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:02.256294 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2ca75e92-f0e9-4d9c-b519-3f2f05e64f74 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:02.257058 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2ca75e92-f0e9-4d9c-b519-3f2f05e64f74 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:02.257532 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2ca75e92-f0e9-4d9c-b519-3f2f05e64f74 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:02.393446 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2ca75e92-f0e9-4d9c-b519-3f2f05e64f74 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:02.401680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2ca75e92-f0e9-4d9c-b519-3f2f05e64f74 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.157292 Jun 26 03:06:02.402278 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 122/251] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:02 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:03.050113 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-518de829-fa41-4c12-93e8-d6e3e029d6a2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:03.050719 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-518de829-fa41-4c12-93e8-d6e3e029d6a2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:03.053053 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=95 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:03.058592 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-518de829-fa41-4c12-93e8-d6e3e029d6a2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:03.059038 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-518de829-fa41-4c12-93e8-d6e3e029d6a2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:03.059795 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-518de829-fa41-4c12-93e8-d6e3e029d6a2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:03.060228 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-518de829-fa41-4c12-93e8-d6e3e029d6a2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:03.193312 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-518de829-fa41-4c12-93e8-d6e3e029d6a2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:03.200812 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-518de829-fa41-4c12-93e8-d6e3e029d6a2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.154476 Jun 26 03:06:03.201387 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 130/252] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:03 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:03.419008 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-46588d78-04a1-4e14-b709-9a5688ec1bc4 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:03.419612 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-46588d78-04a1-4e14-b709-9a5688ec1bc4 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:03.425967 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-46588d78-04a1-4e14-b709-9a5688ec1bc4 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:03.426534 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-46588d78-04a1-4e14-b709-9a5688ec1bc4 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:03.427284 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-46588d78-04a1-4e14-b709-9a5688ec1bc4 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:03.427717 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-46588d78-04a1-4e14-b709-9a5688ec1bc4 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:03.557099 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-46588d78-04a1-4e14-b709-9a5688ec1bc4 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:03.565187 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-46588d78-04a1-4e14-b709-9a5688ec1bc4 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.150202 Jun 26 03:06:03.566290 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 123/253] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:03 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:04.218620 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b3505cf4-a65e-421f-ba49-a503f6144710 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:04.219231 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b3505cf4-a65e-421f-ba49-a503f6144710 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:04.225666 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b3505cf4-a65e-421f-ba49-a503f6144710 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:04.226167 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b3505cf4-a65e-421f-ba49-a503f6144710 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:04.226924 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b3505cf4-a65e-421f-ba49-a503f6144710 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:04.227363 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b3505cf4-a65e-421f-ba49-a503f6144710 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:04.244967 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:04.357242 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b3505cf4-a65e-421f-ba49-a503f6144710 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:04.364615 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b3505cf4-a65e-421f-ba49-a503f6144710 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.150460 Jun 26 03:06:04.365183 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 131/254] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:04 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:04.582853 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fff0c40e-7570-4389-9005-eb476a464848 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:04.583387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-fff0c40e-7570-4389-9005-eb476a464848 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:04.589481 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fff0c40e-7570-4389-9005-eb476a464848 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:04.589935 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fff0c40e-7570-4389-9005-eb476a464848 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:04.590718 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fff0c40e-7570-4389-9005-eb476a464848 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:04.591156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fff0c40e-7570-4389-9005-eb476a464848 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:04.724695 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-fff0c40e-7570-4389-9005-eb476a464848 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:04.732388 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-fff0c40e-7570-4389-9005-eb476a464848 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.153372 Jun 26 03:06:04.732949 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 124/255] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:04 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:05.381370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-61e7f7c9-7248-4258-be79-e7ee99464b9b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:05.381977 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-61e7f7c9-7248-4258-be79-e7ee99464b9b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:05.388396 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-61e7f7c9-7248-4258-be79-e7ee99464b9b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:05.388848 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-61e7f7c9-7248-4258-be79-e7ee99464b9b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:05.390244 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-61e7f7c9-7248-4258-be79-e7ee99464b9b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:05.390688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-61e7f7c9-7248-4258-be79-e7ee99464b9b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:05.518522 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-61e7f7c9-7248-4258-be79-e7ee99464b9b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:05.525833 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-61e7f7c9-7248-4258-be79-e7ee99464b9b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.148524 Jun 26 03:06:05.526422 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 132/256] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:05 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:05.748495 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c54e1ebb-7abf-4a58-9712-e79a8b02b910 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:05.749747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c54e1ebb-7abf-4a58-9712-e79a8b02b910 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:05.757227 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c54e1ebb-7abf-4a58-9712-e79a8b02b910 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:05.757658 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c54e1ebb-7abf-4a58-9712-e79a8b02b910 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:05.758442 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c54e1ebb-7abf-4a58-9712-e79a8b02b910 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:05.758871 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c54e1ebb-7abf-4a58-9712-e79a8b02b910 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:05.887520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c54e1ebb-7abf-4a58-9712-e79a8b02b910 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:05.895391 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c54e1ebb-7abf-4a58-9712-e79a8b02b910 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.150720 Jun 26 03:06:05.895984 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 125/257] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:05 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:06.542429 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1879d948-b48f-4f97-b872-ff5b208ce968 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:06.543004 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1879d948-b48f-4f97-b872-ff5b208ce968 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:06.549841 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1879d948-b48f-4f97-b872-ff5b208ce968 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:06.550333 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1879d948-b48f-4f97-b872-ff5b208ce968 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:06.551094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1879d948-b48f-4f97-b872-ff5b208ce968 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:06.551527 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1879d948-b48f-4f97-b872-ff5b208ce968 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:06.681073 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1879d948-b48f-4f97-b872-ff5b208ce968 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:06.689093 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1879d948-b48f-4f97-b872-ff5b208ce968 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.150557 Jun 26 03:06:06.689649 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 133/258] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:06 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:06.911994 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-df0df874-eb3d-41bd-8fb6-94a40a9ce8ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:06.912599 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-df0df874-eb3d-41bd-8fb6-94a40a9ce8ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:06.918511 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-df0df874-eb3d-41bd-8fb6-94a40a9ce8ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:06.918952 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-df0df874-eb3d-41bd-8fb6-94a40a9ce8ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:06.919705 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-df0df874-eb3d-41bd-8fb6-94a40a9ce8ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:06.920137 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-df0df874-eb3d-41bd-8fb6-94a40a9ce8ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:06.935050 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=2 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:07.044625 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-df0df874-eb3d-41bd-8fb6-94a40a9ce8ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:07.052574 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-df0df874-eb3d-41bd-8fb6-94a40a9ce8ba tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.144383 Jun 26 03:06:07.053146 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 126/259] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:06 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:07.705336 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a41c9afb-df6d-44df-8625-8951f0594df2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:07.705953 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a41c9afb-df6d-44df-8625-8951f0594df2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:07.712514 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a41c9afb-df6d-44df-8625-8951f0594df2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:07.712968 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a41c9afb-df6d-44df-8625-8951f0594df2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:07.713729 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a41c9afb-df6d-44df-8625-8951f0594df2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:07.714201 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a41c9afb-df6d-44df-8625-8951f0594df2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:07.855181 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a41c9afb-df6d-44df-8625-8951f0594df2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:07.863109 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a41c9afb-df6d-44df-8625-8951f0594df2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.161597 Jun 26 03:06:07.863676 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 134/260] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:07 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:08.069837 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-10b3e0f2-6688-4a3c-9f19-8d9467246d00 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:08.070375 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-10b3e0f2-6688-4a3c-9f19-8d9467246d00 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:08.072303 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=8 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:08.078350 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10b3e0f2-6688-4a3c-9f19-8d9467246d00 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:08.078801 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10b3e0f2-6688-4a3c-9f19-8d9467246d00 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:08.079563 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10b3e0f2-6688-4a3c-9f19-8d9467246d00 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:08.080000 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10b3e0f2-6688-4a3c-9f19-8d9467246d00 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:08.221889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-10b3e0f2-6688-4a3c-9f19-8d9467246d00 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:08.230678 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-10b3e0f2-6688-4a3c-9f19-8d9467246d00 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.164614 Jun 26 03:06:08.231458 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 127/261] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:08 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:08.879511 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-494d01e0-357d-4174-be55-7947db3c974e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:08.880119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-494d01e0-357d-4174-be55-7947db3c974e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:08.886554 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-494d01e0-357d-4174-be55-7947db3c974e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:08.887001 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-494d01e0-357d-4174-be55-7947db3c974e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:08.887750 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-494d01e0-357d-4174-be55-7947db3c974e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:08.888183 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-494d01e0-357d-4174-be55-7947db3c974e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:09.014738 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-494d01e0-357d-4174-be55-7947db3c974e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:09.022241 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-494d01e0-357d-4174-be55-7947db3c974e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.146695 Jun 26 03:06:09.022820 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 135/262] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:08 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:09.249200 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d5640c7e-399f-41aa-b918-80aefd095b52 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:09.249807 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d5640c7e-399f-41aa-b918-80aefd095b52 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:09.256028 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d5640c7e-399f-41aa-b918-80aefd095b52 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:09.256472 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d5640c7e-399f-41aa-b918-80aefd095b52 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:09.257223 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d5640c7e-399f-41aa-b918-80aefd095b52 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:09.257656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d5640c7e-399f-41aa-b918-80aefd095b52 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:09.385774 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d5640c7e-399f-41aa-b918-80aefd095b52 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:09.393709 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d5640c7e-399f-41aa-b918-80aefd095b52 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.148257 Jun 26 03:06:09.394319 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 128/263] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:09 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:10.038964 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-14813356-d314-47d3-b0a7-e6fc379734ad tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:10.039627 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-14813356-d314-47d3-b0a7-e6fc379734ad tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:10.045950 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-14813356-d314-47d3-b0a7-e6fc379734ad tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:10.046426 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-14813356-d314-47d3-b0a7-e6fc379734ad tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:10.047181 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-14813356-d314-47d3-b0a7-e6fc379734ad tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:10.047612 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-14813356-d314-47d3-b0a7-e6fc379734ad tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:10.177100 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-14813356-d314-47d3-b0a7-e6fc379734ad tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:10.184545 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-14813356-d314-47d3-b0a7-e6fc379734ad tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.149543 Jun 26 03:06:10.185107 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 136/264] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:10 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:10.409808 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3158026d-f945-42ae-92c1-df94ad93347a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:10.410387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3158026d-f945-42ae-92c1-df94ad93347a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:10.416344 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3158026d-f945-42ae-92c1-df94ad93347a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:10.416795 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3158026d-f945-42ae-92c1-df94ad93347a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:10.417552 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3158026d-f945-42ae-92c1-df94ad93347a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:10.417990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3158026d-f945-42ae-92c1-df94ad93347a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:10.541160 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-3158026d-f945-42ae-92c1-df94ad93347a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:10.549106 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3158026d-f945-42ae-92c1-df94ad93347a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.143114 Jun 26 03:06:10.549677 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 129/265] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:10 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:11.202747 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-26925596-2488-4ecc-a358-c0d2fd2b3a3a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:11.203365 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-26925596-2488-4ecc-a358-c0d2fd2b3a3a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:11.209719 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-26925596-2488-4ecc-a358-c0d2fd2b3a3a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:11.210216 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-26925596-2488-4ecc-a358-c0d2fd2b3a3a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:11.210978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-26925596-2488-4ecc-a358-c0d2fd2b3a3a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:11.211416 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-26925596-2488-4ecc-a358-c0d2fd2b3a3a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:11.338797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-26925596-2488-4ecc-a358-c0d2fd2b3a3a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:11.346425 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-26925596-2488-4ecc-a358-c0d2fd2b3a3a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.147943 Jun 26 03:06:11.346890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 137/266] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:11 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:11.566311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-908b4cf3-4333-4a74-87e4-47397be65395 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:11.566828 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-908b4cf3-4333-4a74-87e4-47397be65395 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:11.572837 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-908b4cf3-4333-4a74-87e4-47397be65395 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:11.573290 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-908b4cf3-4333-4a74-87e4-47397be65395 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:11.574059 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-908b4cf3-4333-4a74-87e4-47397be65395 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:11.574517 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-908b4cf3-4333-4a74-87e4-47397be65395 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:11.702011 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-908b4cf3-4333-4a74-87e4-47397be65395 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:11.709568 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-908b4cf3-4333-4a74-87e4-47397be65395 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.147192 Jun 26 03:06:11.710144 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 130/267] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:11 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:12.366352 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b0e81f1e-49a3-44b1-8ca9-3a8c6fea6f16 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:12.366988 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b0e81f1e-49a3-44b1-8ca9-3a8c6fea6f16 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:12.374003 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b0e81f1e-49a3-44b1-8ca9-3a8c6fea6f16 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:12.374493 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b0e81f1e-49a3-44b1-8ca9-3a8c6fea6f16 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:12.375269 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b0e81f1e-49a3-44b1-8ca9-3a8c6fea6f16 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:12.375741 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b0e81f1e-49a3-44b1-8ca9-3a8c6fea6f16 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:12.570518 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b0e81f1e-49a3-44b1-8ca9-3a8c6fea6f16 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:12.578390 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b0e81f1e-49a3-44b1-8ca9-3a8c6fea6f16 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.216821 Jun 26 03:06:12.578961 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 138/268] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:12 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:12.726304 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-90bf2359-d7d0-4a41-b178-39a40132357c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:12.726740 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-90bf2359-d7d0-4a41-b178-39a40132357c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:12.732841 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-90bf2359-d7d0-4a41-b178-39a40132357c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:12.733339 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-90bf2359-d7d0-4a41-b178-39a40132357c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:12.734139 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-90bf2359-d7d0-4a41-b178-39a40132357c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:12.734589 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-90bf2359-d7d0-4a41-b178-39a40132357c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:12.864935 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-90bf2359-d7d0-4a41-b178-39a40132357c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:12.872551 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-90bf2359-d7d0-4a41-b178-39a40132357c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.150255 Jun 26 03:06:12.873198 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 131/269] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:12 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:13.119642 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-eda5d629-284e-4fda-9266-db855a3c5af8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:13.120145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-eda5d629-284e-4fda-9266-db855a3c5af8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:13.126858 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-eda5d629-284e-4fda-9266-db855a3c5af8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:13.127310 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-eda5d629-284e-4fda-9266-db855a3c5af8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:13.128329 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-eda5d629-284e-4fda-9266-db855a3c5af8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:13.128787 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-eda5d629-284e-4fda-9266-db855a3c5af8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:13.152583 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-eda5d629-284e-4fda-9266-db855a3c5af8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:06:13.237966 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-eda5d629-284e-4fda-9266-db855a3c5af8 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 204 len: 0 microversion: 2.1 time: 0.121895 Jun 26 03:06:13.238578 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 139/270] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:06:13 2022] DELETE /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:06:13.246592 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-51389076-94d9-46f5-a81f-613fc6ab9114 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:13.247363 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-51389076-94d9-46f5-a81f-613fc6ab9114 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:13.254335 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-51389076-94d9-46f5-a81f-613fc6ab9114 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:13.254767 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-51389076-94d9-46f5-a81f-613fc6ab9114 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:13.255617 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-51389076-94d9-46f5-a81f-613fc6ab9114 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:13.256060 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-51389076-94d9-46f5-a81f-613fc6ab9114 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:13.382795 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-51389076-94d9-46f5-a81f-613fc6ab9114 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:13.390574 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-51389076-94d9-46f5-a81f-613fc6ab9114 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1553 microversion: 2.1 time: 0.147805 Jun 26 03:06:13.391138 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 132/271] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:13 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:13.595056 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-5ff15d6b-e929-4edb-a318-ebe4ce654cc2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:13.595681 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-5ff15d6b-e929-4edb-a318-ebe4ce654cc2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:13.602539 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5ff15d6b-e929-4edb-a318-ebe4ce654cc2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:13.602994 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5ff15d6b-e929-4edb-a318-ebe4ce654cc2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:13.603756 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5ff15d6b-e929-4edb-a318-ebe4ce654cc2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:13.604198 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5ff15d6b-e929-4edb-a318-ebe4ce654cc2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:13.732149 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-5ff15d6b-e929-4edb-a318-ebe4ce654cc2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:13.740513 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-5ff15d6b-e929-4edb-a318-ebe4ce654cc2 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.150201 Jun 26 03:06:13.741080 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 140/272] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:13 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:13.890474 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a7f52c4e-ba3b-4ae2-887e-90f33b5b5b72 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:13.891083 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a7f52c4e-ba3b-4ae2-887e-90f33b5b5b72 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:13.897116 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a7f52c4e-ba3b-4ae2-887e-90f33b5b5b72 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:13.897561 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a7f52c4e-ba3b-4ae2-887e-90f33b5b5b72 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:13.898350 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a7f52c4e-ba3b-4ae2-887e-90f33b5b5b72 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:13.898790 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a7f52c4e-ba3b-4ae2-887e-90f33b5b5b72 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:14.026769 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a7f52c4e-ba3b-4ae2-887e-90f33b5b5b72 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:14.036025 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a7f52c4e-ba3b-4ae2-887e-90f33b5b5b72 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.149869 Jun 26 03:06:14.036486 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 133/273] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:13 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:14.407858 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ba055167-b700-4540-8cc7-761f3ddcb150 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:14.408607 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ba055167-b700-4540-8cc7-761f3ddcb150 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:14.415202 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ba055167-b700-4540-8cc7-761f3ddcb150 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:14.415699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ba055167-b700-4540-8cc7-761f3ddcb150 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:14.416529 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ba055167-b700-4540-8cc7-761f3ddcb150 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:14.417010 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ba055167-b700-4540-8cc7-761f3ddcb150 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:14.545118 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ba055167-b700-4540-8cc7-761f3ddcb150 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:14.553383 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ba055167-b700-4540-8cc7-761f3ddcb150 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1553 microversion: 2.1 time: 0.149622 Jun 26 03:06:14.553954 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 141/274] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:14 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:14.756770 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-91a65adc-4508-4005-bb10-1c8af20b540a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:14.757395 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-91a65adc-4508-4005-bb10-1c8af20b540a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:14.763445 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-91a65adc-4508-4005-bb10-1c8af20b540a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:14.763896 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-91a65adc-4508-4005-bb10-1c8af20b540a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:14.764661 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-91a65adc-4508-4005-bb10-1c8af20b540a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:14.765097 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-91a65adc-4508-4005-bb10-1c8af20b540a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:14.898687 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-91a65adc-4508-4005-bb10-1c8af20b540a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:14.907146 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-91a65adc-4508-4005-bb10-1c8af20b540a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.154518 Jun 26 03:06:14.907812 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 134/275] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:14 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:15.052596 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a57675a8-1ff6-4e80-a0bb-e3d95a1ab8de tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:15.053206 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a57675a8-1ff6-4e80-a0bb-e3d95a1ab8de tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:15.060105 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a57675a8-1ff6-4e80-a0bb-e3d95a1ab8de tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:15.060652 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a57675a8-1ff6-4e80-a0bb-e3d95a1ab8de tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:15.061323 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a57675a8-1ff6-4e80-a0bb-e3d95a1ab8de tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:15.061757 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a57675a8-1ff6-4e80-a0bb-e3d95a1ab8de tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:15.208787 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a57675a8-1ff6-4e80-a0bb-e3d95a1ab8de tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:15.218514 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a57675a8-1ff6-4e80-a0bb-e3d95a1ab8de tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.168651 Jun 26 03:06:15.222179 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 142/276] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:15 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:15.570899 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-91e57695-a430-4277-bea2-920adb405489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:15.571461 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-91e57695-a430-4277-bea2-920adb405489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:15.577963 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-91e57695-a430-4277-bea2-920adb405489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:15.578446 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-91e57695-a430-4277-bea2-920adb405489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:15.579209 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-91e57695-a430-4277-bea2-920adb405489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:15.579651 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-91e57695-a430-4277-bea2-920adb405489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:15.597721 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=100 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:15.721661 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-91e57695-a430-4277-bea2-920adb405489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:15.730524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-91e57695-a430-4277-bea2-920adb405489 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1553 microversion: 2.1 time: 0.163692 Jun 26 03:06:15.731095 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 135/277] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:15 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:15.924413 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d89c2add-903c-4337-b849-1186aed047cf tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:15.925123 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d89c2add-903c-4337-b849-1186aed047cf tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:15.932830 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d89c2add-903c-4337-b849-1186aed047cf tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:15.933635 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d89c2add-903c-4337-b849-1186aed047cf tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:15.934546 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d89c2add-903c-4337-b849-1186aed047cf tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:15.935080 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d89c2add-903c-4337-b849-1186aed047cf tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:16.066200 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d89c2add-903c-4337-b849-1186aed047cf tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:16.073838 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d89c2add-903c-4337-b849-1186aed047cf tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.153903 Jun 26 03:06:16.074376 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 143/278] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:15 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:16.237110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-52928b79-4302-42b3-baf3-79831469b709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:16.237727 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-52928b79-4302-42b3-baf3-79831469b709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:16.243759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-52928b79-4302-42b3-baf3-79831469b709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:16.244238 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-52928b79-4302-42b3-baf3-79831469b709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:16.244997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-52928b79-4302-42b3-baf3-79831469b709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:16.245431 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-52928b79-4302-42b3-baf3-79831469b709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:16.507245 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-52928b79-4302-42b3-baf3-79831469b709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:16.514703 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-52928b79-4302-42b3-baf3-79831469b709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.282775 Jun 26 03:06:16.515275 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 136/279] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:16 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:16.747316 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d05d9fbd-57e1-42cc-8cd7-ed32f4ab2115 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:16.747945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d05d9fbd-57e1-42cc-8cd7-ed32f4ab2115 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:16.754103 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d05d9fbd-57e1-42cc-8cd7-ed32f4ab2115 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:16.754556 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d05d9fbd-57e1-42cc-8cd7-ed32f4ab2115 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:16.755311 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d05d9fbd-57e1-42cc-8cd7-ed32f4ab2115 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:16.755744 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d05d9fbd-57e1-42cc-8cd7-ed32f4ab2115 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:16.883503 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d05d9fbd-57e1-42cc-8cd7-ed32f4ab2115 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:16.891844 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d05d9fbd-57e1-42cc-8cd7-ed32f4ab2115 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1553 microversion: 2.1 time: 0.148394 Jun 26 03:06:16.892404 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 144/280] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:16 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:17.091168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b07ca176-ef8f-49d5-8d5c-0e00efc71fb5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:17.091887 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b07ca176-ef8f-49d5-8d5c-0e00efc71fb5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:17.098532 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b07ca176-ef8f-49d5-8d5c-0e00efc71fb5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:17.098981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b07ca176-ef8f-49d5-8d5c-0e00efc71fb5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:17.099753 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b07ca176-ef8f-49d5-8d5c-0e00efc71fb5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:17.100191 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b07ca176-ef8f-49d5-8d5c-0e00efc71fb5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:17.239987 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b07ca176-ef8f-49d5-8d5c-0e00efc71fb5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:17.246804 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b07ca176-ef8f-49d5-8d5c-0e00efc71fb5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.159565 Jun 26 03:06:17.247370 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 137/281] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:17 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:17.531786 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a0e34c46-5026-4011-b823-866f09409e1a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:17.532397 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a0e34c46-5026-4011-b823-866f09409e1a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:17.538987 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0e34c46-5026-4011-b823-866f09409e1a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:17.539435 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0e34c46-5026-4011-b823-866f09409e1a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:17.540219 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0e34c46-5026-4011-b823-866f09409e1a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:17.540657 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0e34c46-5026-4011-b823-866f09409e1a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:17.669580 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a0e34c46-5026-4011-b823-866f09409e1a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:17.678053 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a0e34c46-5026-4011-b823-866f09409e1a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.150522 Jun 26 03:06:17.678638 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 145/282] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:17 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:17.908366 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b5dcbd09-959d-414b-804c-f5f1af99cdd2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:17.908964 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b5dcbd09-959d-414b-804c-f5f1af99cdd2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:17.914853 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b5dcbd09-959d-414b-804c-f5f1af99cdd2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:17.915300 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b5dcbd09-959d-414b-804c-f5f1af99cdd2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:17.916060 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b5dcbd09-959d-414b-804c-f5f1af99cdd2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:17.916492 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b5dcbd09-959d-414b-804c-f5f1af99cdd2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:18.049673 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b5dcbd09-959d-414b-804c-f5f1af99cdd2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:18.064208 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b5dcbd09-959d-414b-804c-f5f1af99cdd2 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1553 microversion: 2.1 time: 0.159150 Jun 26 03:06:18.075372 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 138/283] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:17 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:18.264680 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f9969095-c66e-40a3-9948-c18cc36548ff tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:18.265304 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f9969095-c66e-40a3-9948-c18cc36548ff tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:18.271260 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9969095-c66e-40a3-9948-c18cc36548ff tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:18.271713 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9969095-c66e-40a3-9948-c18cc36548ff tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:18.272473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9969095-c66e-40a3-9948-c18cc36548ff tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:18.272912 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9969095-c66e-40a3-9948-c18cc36548ff tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:18.290583 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:18.404020 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f9969095-c66e-40a3-9948-c18cc36548ff tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:18.411981 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f9969095-c66e-40a3-9948-c18cc36548ff tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.151670 Jun 26 03:06:18.412548 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 146/284] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:18 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:18.695103 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-dd7c79e7-b34e-4c31-8515-8c910a4b4207 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:18.695709 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-dd7c79e7-b34e-4c31-8515-8c910a4b4207 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:18.702420 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd7c79e7-b34e-4c31-8515-8c910a4b4207 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:18.702863 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd7c79e7-b34e-4c31-8515-8c910a4b4207 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:18.703623 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd7c79e7-b34e-4c31-8515-8c910a4b4207 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:18.704070 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd7c79e7-b34e-4c31-8515-8c910a4b4207 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:18.829584 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-dd7c79e7-b34e-4c31-8515-8c910a4b4207 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:18.836929 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-dd7c79e7-b34e-4c31-8515-8c910a4b4207 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.145763 Jun 26 03:06:18.837484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 139/285] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:18 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:19.082199 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3c00ec97-5d38-4e37-9c4c-f1591b339dbe tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:19.082730 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3c00ec97-5d38-4e37-9c4c-f1591b339dbe tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:19.089055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c00ec97-5d38-4e37-9c4c-f1591b339dbe tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:19.089510 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c00ec97-5d38-4e37-9c4c-f1591b339dbe tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:19.090304 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c00ec97-5d38-4e37-9c4c-f1591b339dbe tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:19.090735 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c00ec97-5d38-4e37-9c4c-f1591b339dbe tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:19.212881 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3c00ec97-5d38-4e37-9c4c-f1591b339dbe tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:19.220957 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3c00ec97-5d38-4e37-9c4c-f1591b339dbe tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1553 microversion: 2.1 time: 0.142745 Jun 26 03:06:19.221882 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 147/286] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:19 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1553 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:19.427991 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d8b5e4c4-f751-43a3-b7e6-e1279c9713fd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:19.428596 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d8b5e4c4-f751-43a3-b7e6-e1279c9713fd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:19.434501 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d8b5e4c4-f751-43a3-b7e6-e1279c9713fd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:19.434943 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d8b5e4c4-f751-43a3-b7e6-e1279c9713fd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:19.435694 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d8b5e4c4-f751-43a3-b7e6-e1279c9713fd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:19.436777 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d8b5e4c4-f751-43a3-b7e6-e1279c9713fd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:19.567657 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d8b5e4c4-f751-43a3-b7e6-e1279c9713fd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:19.573338 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d8b5e4c4-f751-43a3-b7e6-e1279c9713fd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.148997 Jun 26 03:06:19.573877 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 140/287] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:19 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:19.853278 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e0180f37-40eb-490b-b785-6234362dcbcb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:19.853888 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e0180f37-40eb-490b-b785-6234362dcbcb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:19.860575 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e0180f37-40eb-490b-b785-6234362dcbcb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:19.861031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e0180f37-40eb-490b-b785-6234362dcbcb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:19.861800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e0180f37-40eb-490b-b785-6234362dcbcb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:19.862285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e0180f37-40eb-490b-b785-6234362dcbcb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:19.985484 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e0180f37-40eb-490b-b785-6234362dcbcb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:19.992903 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e0180f37-40eb-490b-b785-6234362dcbcb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.143421 Jun 26 03:06:19.993467 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 148/288] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:19 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:20.237203 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-58d1db9c-613b-43b9-a31a-20156ac1e55d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:20.237722 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-58d1db9c-613b-43b9-a31a-20156ac1e55d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:20.243699 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-58d1db9c-613b-43b9-a31a-20156ac1e55d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:20.244158 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-58d1db9c-613b-43b9-a31a-20156ac1e55d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:20.244960 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-58d1db9c-613b-43b9-a31a-20156ac1e55d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:20.245403 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-58d1db9c-613b-43b9-a31a-20156ac1e55d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:20.371523 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-58d1db9c-613b-43b9-a31a-20156ac1e55d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:20.380242 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-58d1db9c-613b-43b9-a31a-20156ac1e55d tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1553 microversion: 2.1 time: 0.146994 Jun 26 03:06:20.380811 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 141/289] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:20 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:20.589739 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4f08903f-5445-4374-93ce-6d155f7d66a0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:20.590290 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4f08903f-5445-4374-93ce-6d155f7d66a0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:20.596719 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4f08903f-5445-4374-93ce-6d155f7d66a0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:20.597169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4f08903f-5445-4374-93ce-6d155f7d66a0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:20.597931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4f08903f-5445-4374-93ce-6d155f7d66a0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:20.598405 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4f08903f-5445-4374-93ce-6d155f7d66a0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:20.722620 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4f08903f-5445-4374-93ce-6d155f7d66a0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:20.729893 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4f08903f-5445-4374-93ce-6d155f7d66a0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.144068 Jun 26 03:06:20.730484 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 149/290] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:20 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:21.009556 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c70dd0bf-aa6f-4cab-9849-bf4170f812d5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:21.010202 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c70dd0bf-aa6f-4cab-9849-bf4170f812d5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:21.016212 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c70dd0bf-aa6f-4cab-9849-bf4170f812d5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:21.016666 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c70dd0bf-aa6f-4cab-9849-bf4170f812d5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:21.017429 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c70dd0bf-aa6f-4cab-9849-bf4170f812d5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:21.017869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c70dd0bf-aa6f-4cab-9849-bf4170f812d5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:21.142713 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c70dd0bf-aa6f-4cab-9849-bf4170f812d5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:21.150022 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c70dd0bf-aa6f-4cab-9849-bf4170f812d5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.144277 Jun 26 03:06:21.150601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 142/291] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:21 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:21.397778 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-420b40e4-f1fe-40d0-8000-d17d10bae9ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:21.398337 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-420b40e4-f1fe-40d0-8000-d17d10bae9ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:21.404267 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-420b40e4-f1fe-40d0-8000-d17d10bae9ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:21.404721 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-420b40e4-f1fe-40d0-8000-d17d10bae9ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:21.406173 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-420b40e4-f1fe-40d0-8000-d17d10bae9ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:21.406616 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-420b40e4-f1fe-40d0-8000-d17d10bae9ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:21.534285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-420b40e4-f1fe-40d0-8000-d17d10bae9ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:21.542300 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-420b40e4-f1fe-40d0-8000-d17d10bae9ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1553 microversion: 2.1 time: 0.148473 Jun 26 03:06:21.542870 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 150/292] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:21 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:21.746129 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d10ee424-c80b-4900-bdea-6f91694945d9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:21.746679 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d10ee424-c80b-4900-bdea-6f91694945d9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:21.752592 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d10ee424-c80b-4900-bdea-6f91694945d9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:21.753035 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d10ee424-c80b-4900-bdea-6f91694945d9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:21.754032 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d10ee424-c80b-4900-bdea-6f91694945d9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:21.754510 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d10ee424-c80b-4900-bdea-6f91694945d9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:21.879083 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d10ee424-c80b-4900-bdea-6f91694945d9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:21.886563 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d10ee424-c80b-4900-bdea-6f91694945d9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.144341 Jun 26 03:06:21.887147 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 143/293] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:21 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:22.166687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-413410b5-f90e-46c6-b866-5dc5ed7babee tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:22.167300 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-413410b5-f90e-46c6-b866-5dc5ed7babee tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:22.173673 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-413410b5-f90e-46c6-b866-5dc5ed7babee tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:22.174151 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-413410b5-f90e-46c6-b866-5dc5ed7babee tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:22.174910 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-413410b5-f90e-46c6-b866-5dc5ed7babee tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:22.175348 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-413410b5-f90e-46c6-b866-5dc5ed7babee tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:22.300893 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-413410b5-f90e-46c6-b866-5dc5ed7babee tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:22.308486 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-413410b5-f90e-46c6-b866-5dc5ed7babee tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.145587 Jun 26 03:06:22.309043 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 151/294] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:22 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:22.559171 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b1b9e7cc-b8cc-4c62-8abb-60608304af89 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:22.559718 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b1b9e7cc-b8cc-4c62-8abb-60608304af89 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:22.566221 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b1b9e7cc-b8cc-4c62-8abb-60608304af89 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:22.566678 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b1b9e7cc-b8cc-4c62-8abb-60608304af89 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:22.567434 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b1b9e7cc-b8cc-4c62-8abb-60608304af89 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:22.567869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b1b9e7cc-b8cc-4c62-8abb-60608304af89 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:22.692488 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b1b9e7cc-b8cc-4c62-8abb-60608304af89 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:22.700306 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b1b9e7cc-b8cc-4c62-8abb-60608304af89 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1553 microversion: 2.1 time: 0.145103 Jun 26 03:06:22.700866 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 144/295] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:22 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:22.903376 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-12066137-9c7b-4e16-9fde-2efa40ecc3c8 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:22.903986 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-12066137-9c7b-4e16-9fde-2efa40ecc3c8 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:22.910400 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-12066137-9c7b-4e16-9fde-2efa40ecc3c8 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:22.910853 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-12066137-9c7b-4e16-9fde-2efa40ecc3c8 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:22.911611 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-12066137-9c7b-4e16-9fde-2efa40ecc3c8 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:22.912048 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-12066137-9c7b-4e16-9fde-2efa40ecc3c8 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:23.037818 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-12066137-9c7b-4e16-9fde-2efa40ecc3c8 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:23.045078 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-12066137-9c7b-4e16-9fde-2efa40ecc3c8 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.145473 Jun 26 03:06:23.046305 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 152/296] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:22 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:23.326347 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-78c7216b-93e0-45ee-89b6-5332a58623e8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:23.327627 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-78c7216b-93e0-45ee-89b6-5332a58623e8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:23.333083 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:23.335004 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-78c7216b-93e0-45ee-89b6-5332a58623e8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:23.335658 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-78c7216b-93e0-45ee-89b6-5332a58623e8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:23.336640 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-78c7216b-93e0-45ee-89b6-5332a58623e8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:23.337076 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-78c7216b-93e0-45ee-89b6-5332a58623e8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:23.369329 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-26c20476-a979-4ed6-aa29-c2a8b8b56b3e req-b4c38e75-778e-4903-94f2-8b97d4b3b751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "690029c3-471e-45f0-899e-3f57c61ca236", "name": "network-vif-plugged", "status": "completed", "tag": "71302763-1081-4376-b087-f298db36489e"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:06:23.385671 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-26c20476-a979-4ed6-aa29-c2a8b8b56b3e req-b4c38e75-778e-4903-94f2-8b97d4b3b751 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:23.386264 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-26c20476-a979-4ed6-aa29-c2a8b8b56b3e req-b4c38e75-778e-4903-94f2-8b97d4b3b751 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:23.410098 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-26c20476-a979-4ed6-aa29-c2a8b8b56b3e req-b4c38e75-778e-4903-94f2-8b97d4b3b751 service nova] Creating event network-vif-plugged:71302763-1081-4376-b087-f298db36489e for instance 690029c3-471e-45f0-899e-3f57c61ca236 on hv-cinder-84684 Jun 26 03:06:23.415387 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-26c20476-a979-4ed6-aa29-c2a8b8b56b3e req-b4c38e75-778e-4903-94f2-8b97d4b3b751 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049819 Jun 26 03:06:23.416565 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 153/297] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:06:23.513570 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-78c7216b-93e0-45ee-89b6-5332a58623e8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:23.521690 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-78c7216b-93e0-45ee-89b6-5332a58623e8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.200469 Jun 26 03:06:23.522612 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 145/298] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:23 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:23.718203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2a11a89a-4135-4a22-92b5-abfec5403c32 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:23.718826 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2a11a89a-4135-4a22-92b5-abfec5403c32 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:23.725914 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a11a89a-4135-4a22-92b5-abfec5403c32 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:23.726399 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a11a89a-4135-4a22-92b5-abfec5403c32 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:23.727149 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a11a89a-4135-4a22-92b5-abfec5403c32 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:23.727581 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a11a89a-4135-4a22-92b5-abfec5403c32 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:23.859449 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-2a11a89a-4135-4a22-92b5-abfec5403c32 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:23.867730 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2a11a89a-4135-4a22-92b5-abfec5403c32 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1553 microversion: 2.1 time: 0.154415 Jun 26 03:06:23.868296 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 154/299] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:23 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:24.062371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-108adb61-0acc-47cf-b482-805b92f1a52d tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:24.063216 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-108adb61-0acc-47cf-b482-805b92f1a52d tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:24.069813 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-108adb61-0acc-47cf-b482-805b92f1a52d tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:24.070467 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-108adb61-0acc-47cf-b482-805b92f1a52d tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:24.071251 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-108adb61-0acc-47cf-b482-805b92f1a52d tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:24.071757 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-108adb61-0acc-47cf-b482-805b92f1a52d tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:24.198837 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-108adb61-0acc-47cf-b482-805b92f1a52d tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:24.206635 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-108adb61-0acc-47cf-b482-805b92f1a52d tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.148805 Jun 26 03:06:24.207194 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 146/300] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:24 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:24.544172 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-31cfc2b2-23df-496f-a05a-b52d73d5de47 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:24.544740 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-31cfc2b2-23df-496f-a05a-b52d73d5de47 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:24.551596 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-31cfc2b2-23df-496f-a05a-b52d73d5de47 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:24.552056 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-31cfc2b2-23df-496f-a05a-b52d73d5de47 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:24.552843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-31cfc2b2-23df-496f-a05a-b52d73d5de47 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:24.553288 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-31cfc2b2-23df-496f-a05a-b52d73d5de47 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:24.843476 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-31cfc2b2-23df-496f-a05a-b52d73d5de47 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:24.858635 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-31cfc2b2-23df-496f-a05a-b52d73d5de47 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.317728 Jun 26 03:06:24.871051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 155/301] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:24 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:24.887165 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-71b9634b-67b1-447f-896a-b68f7051d9d5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:24.887858 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-71b9634b-67b1-447f-896a-b68f7051d9d5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:24.895359 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-71b9634b-67b1-447f-896a-b68f7051d9d5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:24.895897 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-71b9634b-67b1-447f-896a-b68f7051d9d5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:24.896742 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-71b9634b-67b1-447f-896a-b68f7051d9d5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:24.897252 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-71b9634b-67b1-447f-896a-b68f7051d9d5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:25.090120 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-71b9634b-67b1-447f-896a-b68f7051d9d5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:25.101604 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-71b9634b-67b1-447f-896a-b68f7051d9d5 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1553 microversion: 2.1 time: 0.219683 Jun 26 03:06:25.110188 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 147/302] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:24 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:25.204448 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-8b3ac7fe-54a5-407b-b5d8-98f1ff302d49 req-8c4d455f-3069-4b47-87a6-3ccbf3adb7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a", "name": "network-vif-deleted", "tag": "d9366ecd-7ca4-4109-bdc7-b47e7cb83078"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:06:25.212892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-8b3ac7fe-54a5-407b-b5d8-98f1ff302d49 req-8c4d455f-3069-4b47-87a6-3ccbf3adb7a3 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:25.213333 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-8b3ac7fe-54a5-407b-b5d8-98f1ff302d49 req-8c4d455f-3069-4b47-87a6-3ccbf3adb7a3 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:25.226468 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-82c9b6c4-44e2-4c51-8b73-e9abe80c3b92 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:25.227369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-82c9b6c4-44e2-4c51-8b73-e9abe80c3b92 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:25.228801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-8b3ac7fe-54a5-407b-b5d8-98f1ff302d49 req-8c4d455f-3069-4b47-87a6-3ccbf3adb7a3 service nova] Creating event network-vif-deleted:d9366ecd-7ca4-4109-bdc7-b47e7cb83078 for instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a on hv-cinder-84684 Jun 26 03:06:25.234527 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-8b3ac7fe-54a5-407b-b5d8-98f1ff302d49 req-8c4d455f-3069-4b47-87a6-3ccbf3adb7a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035025 Jun 26 03:06:25.235146 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 156/303] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:06:25.240118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-82c9b6c4-44e2-4c51-8b73-e9abe80c3b92 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:25.240581 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-82c9b6c4-44e2-4c51-8b73-e9abe80c3b92 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:25.241349 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-82c9b6c4-44e2-4c51-8b73-e9abe80c3b92 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:25.241799 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-82c9b6c4-44e2-4c51-8b73-e9abe80c3b92 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:25.387805 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-82c9b6c4-44e2-4c51-8b73-e9abe80c3b92 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:25.395549 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-82c9b6c4-44e2-4c51-8b73-e9abe80c3b92 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1314 microversion: 2.1 time: 0.173020 Jun 26 03:06:25.396050 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 148/304] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:25 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:25.878394 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d4cd7195-e86c-4764-80e9-44348be0bc99 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:25.880217 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d4cd7195-e86c-4764-80e9-44348be0bc99 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:25.887312 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d4cd7195-e86c-4764-80e9-44348be0bc99 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:25.887840 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d4cd7195-e86c-4764-80e9-44348be0bc99 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:25.888934 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d4cd7195-e86c-4764-80e9-44348be0bc99 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:25.890022 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d4cd7195-e86c-4764-80e9-44348be0bc99 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:26.030905 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d4cd7195-e86c-4764-80e9-44348be0bc99 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:26.039441 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d4cd7195-e86c-4764-80e9-44348be0bc99 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.167351 Jun 26 03:06:26.040667 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 157/305] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:25 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:26.121262 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a7f9ef2d-cffd-46f0-ba02-0cc1c0e81d7a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:26.125407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a7f9ef2d-cffd-46f0-ba02-0cc1c0e81d7a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:26.135614 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a7f9ef2d-cffd-46f0-ba02-0cc1c0e81d7a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:26.136089 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a7f9ef2d-cffd-46f0-ba02-0cc1c0e81d7a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:26.137216 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a7f9ef2d-cffd-46f0-ba02-0cc1c0e81d7a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:26.137900 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a7f9ef2d-cffd-46f0-ba02-0cc1c0e81d7a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:26.221391 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a7f9ef2d-cffd-46f0-ba02-0cc1c0e81d7a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e31454d9aa47f38f09f016399f9b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23078d86cd394c749328fb9dd7992919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:26.230022 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a7f9ef2d-cffd-46f0-ba02-0cc1c0e81d7a tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 200 len: 1345 microversion: 2.1 time: 0.113183 Jun 26 03:06:26.230862 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 149/306] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:26 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 1345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:26.413419 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-862ef12b-ac1b-4874-8bba-45d1f9b11f50 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:26.414072 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-862ef12b-ac1b-4874-8bba-45d1f9b11f50 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:26.420832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-862ef12b-ac1b-4874-8bba-45d1f9b11f50 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:26.421656 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-862ef12b-ac1b-4874-8bba-45d1f9b11f50 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:26.422441 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-862ef12b-ac1b-4874-8bba-45d1f9b11f50 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:26.422922 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-862ef12b-ac1b-4874-8bba-45d1f9b11f50 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:26.565796 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-862ef12b-ac1b-4874-8bba-45d1f9b11f50 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:26.573217 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-862ef12b-ac1b-4874-8bba-45d1f9b11f50 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1497 microversion: 2.1 time: 0.163902 Jun 26 03:06:26.573826 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 158/307] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:26 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:27.056244 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-299a0e2d-3686-4bbb-b08f-808807ce6a78 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:27.057402 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-299a0e2d-3686-4bbb-b08f-808807ce6a78 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:27.067410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-299a0e2d-3686-4bbb-b08f-808807ce6a78 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:27.068406 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-299a0e2d-3686-4bbb-b08f-808807ce6a78 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:27.069372 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-299a0e2d-3686-4bbb-b08f-808807ce6a78 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:27.069872 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-299a0e2d-3686-4bbb-b08f-808807ce6a78 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:27.098005 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f4cb264a-eada-4c1b-8aa8-557a4314f09e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:27.098474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f4cb264a-eada-4c1b-8aa8-557a4314f09e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:27.105087 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f4cb264a-eada-4c1b-8aa8-557a4314f09e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:27.105665 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f4cb264a-eada-4c1b-8aa8-557a4314f09e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:27.106590 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f4cb264a-eada-4c1b-8aa8-557a4314f09e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:27.107178 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f4cb264a-eada-4c1b-8aa8-557a4314f09e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:27.297499 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-299a0e2d-3686-4bbb-b08f-808807ce6a78 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:27.310136 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-299a0e2d-3686-4bbb-b08f-808807ce6a78 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.256638 Jun 26 03:06:27.311458 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 150/308] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:27 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:27.321628 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fdd710cc-55b0-4cd0-b3a0-7741fa2c8b2c tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:27.324357 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-fdd710cc-55b0-4cd0-b3a0-7741fa2c8b2c tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:27.349049 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fdd710cc-55b0-4cd0-b3a0-7741fa2c8b2c tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:27.349433 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fdd710cc-55b0-4cd0-b3a0-7741fa2c8b2c tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:27.351914 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fdd710cc-55b0-4cd0-b3a0-7741fa2c8b2c tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:27.361518 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f4cb264a-eada-4c1b-8aa8-557a4314f09e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:06:27.362856 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fdd710cc-55b0-4cd0-b3a0-7741fa2c8b2c tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:27.390432 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-fdd710cc-55b0-4cd0-b3a0-7741fa2c8b2c tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] HTTP exception thrown: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fdd710cc-55b0-4cd0-b3a0-7741fa2c8b2c tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Request method failure captured: Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a HTTP/1.1 Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zRh8Qb_pJf5JzW5ezA-d7dTrGPFdCJDLzvI6AaIh3kadwjIYGl4g5pDWJf01n2WCKujiGtrQdrxBUBsQgv8088NLkdBXlbQB1wiXdxfi67oDE8_MZnRS1bLo0dj3cclIHMnwt12tXQjoXMjlZ00lcz_w82bXvYNdW8kH2EZbdErxc Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 23078d86cd394c749328fb9dd7992919 Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-DeleteServersTestJSON-20252491 Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:06:27.396072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:06:27.398696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_23078d86cd394c749328fb9dd7992919"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/23078d86cd394c749328fb9dd7992919"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23078d86cd394c749328fb9dd7992919"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23078d86cd394c749328fb9dd7992919"}]}] Jun 26 03:06:27.398696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-DeleteServersTestJSON-20252491 Jun 26 03:06:27.398696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 23078d86cd394c749328fb9dd7992919 Jun 26 03:06:27.398696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-DeleteServersTestJSON-20252491 Jun 26 03:06:27.398696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-DeleteServersTestJSON-20252491-project Jun 26 03:06:27.398696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:06:27.398696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:06:27.398696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 99e31454d9aa47f38f09f016399f9b86 Jun 26 03:06:27.398696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-DeleteServersTestJSON-20252491-project Jun 26 03:06:27.398696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:06:27.398696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:27.398696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a'} Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:06:27.400235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:27.403912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:06:27.405670 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fdd710cc-55b0-4cd0-b3a0-7741fa2c8b2c tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Returning 404 to user: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:06:27.405670 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-fdd710cc-55b0-4cd0-b3a0-7741fa2c8b2c tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 404 len: 111 microversion: 2.1 time: 0.084951 Jun 26 03:06:27.405670 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 151/309] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:27 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:06:27.464654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f4cb264a-eada-4c1b-8aa8-557a4314f09e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "DELETE /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 204 len: 0 microversion: 2.1 time: 0.371943 Jun 26 03:06:27.465468 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 159/310] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:06:27 2022] DELETE /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 26 03:06:27.473461 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8cc06d4b-d555-47b5-bf2b-2d6530597ac0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:27.474161 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8cc06d4b-d555-47b5-bf2b-2d6530597ac0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:27.480298 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8cc06d4b-d555-47b5-bf2b-2d6530597ac0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:27.480759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8cc06d4b-d555-47b5-bf2b-2d6530597ac0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:27.481528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8cc06d4b-d555-47b5-bf2b-2d6530597ac0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:27.481970 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8cc06d4b-d555-47b5-bf2b-2d6530597ac0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:27.537559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-7c041308-d425-4c66-ab97-da66497130ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:27.538804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-7c041308-d425-4c66-ab97-da66497130ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:27.546864 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7c041308-d425-4c66-ab97-da66497130ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:27.547451 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7c041308-d425-4c66-ab97-da66497130ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:27.548595 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7c041308-d425-4c66-ab97-da66497130ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:27.549134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7c041308-d425-4c66-ab97-da66497130ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:27.564302 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-7c041308-d425-4c66-ab97-da66497130ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] HTTP exception thrown: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-7c041308-d425-4c66-ab97-da66497130ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Request method failure captured: Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a/os-volume_attachments HTTP/1.1 Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zRh8Qb_pJf5JzW5ezA-d7dTrGPFdCJDLzvI6AaIh3kadwjIYGl4g5pDWJf01n2WCKujiGtrQdrxBUBsQgv8088NLkdBXlbQB1wiXdxfi67oDE8_MZnRS1bLo0dj3cclIHMnwt12tXQjoXMjlZ00lcz_w82bXvYNdW8kH2EZbdErxc Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 23078d86cd394c749328fb9dd7992919 Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-DeleteServersTestJSON-20252491 Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:06:27.574654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:06:27.576051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_23078d86cd394c749328fb9dd7992919"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/23078d86cd394c749328fb9dd7992919"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23078d86cd394c749328fb9dd7992919"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23078d86cd394c749328fb9dd7992919"}]}] Jun 26 03:06:27.576051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-DeleteServersTestJSON-20252491 Jun 26 03:06:27.576051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 23078d86cd394c749328fb9dd7992919 Jun 26 03:06:27.576051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-DeleteServersTestJSON-20252491 Jun 26 03:06:27.576051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-DeleteServersTestJSON-20252491-project Jun 26 03:06:27.576051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:06:27.576051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:06:27.576051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 99e31454d9aa47f38f09f016399f9b86 Jun 26 03:06:27.576051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-DeleteServersTestJSON-20252491-project Jun 26 03:06:27.576051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:06:27.576051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:27.576051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'server_id': '0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a'} Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:06:27.577370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:27.578654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:27.581366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-7c041308-d425-4c66-ab97-da66497130ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Returning 404 to user: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:06:27.582964 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-7c041308-d425-4c66-ab97-da66497130ef tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049973 Jun 26 03:06:27.583534 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 160/311] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:06:27 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:06:27.641012 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8cc06d4b-d555-47b5-bf2b-2d6530597ac0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:27.643815 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=100 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:27.648885 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8cc06d4b-d555-47b5-bf2b-2d6530597ac0 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1503 microversion: 2.1 time: 0.179350 Jun 26 03:06:27.649445 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 152/312] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:27 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:28.327194 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f9733231-ac55-4828-9002-3e6d798645a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:28.328522 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f9733231-ac55-4828-9002-3e6d798645a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:28.337148 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9733231-ac55-4828-9002-3e6d798645a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:28.337599 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9733231-ac55-4828-9002-3e6d798645a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:28.338722 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9733231-ac55-4828-9002-3e6d798645a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:28.339326 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9733231-ac55-4828-9002-3e6d798645a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:28.487582 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f9733231-ac55-4828-9002-3e6d798645a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:28.494510 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f9733231-ac55-4828-9002-3e6d798645a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.171107 Jun 26 03:06:28.495631 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 161/313] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:28 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:28.668995 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3bec8459-4e34-409d-b4df-28f541d0d340 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:28.669544 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3bec8459-4e34-409d-b4df-28f541d0d340 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:28.679019 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3bec8459-4e34-409d-b4df-28f541d0d340 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:28.679710 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3bec8459-4e34-409d-b4df-28f541d0d340 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:28.680784 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3bec8459-4e34-409d-b4df-28f541d0d340 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:28.681628 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3bec8459-4e34-409d-b4df-28f541d0d340 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:28.806025 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-33c3b08f-93ed-4db5-bd77-09c6e9e5c6fc tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:28.815176 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-33c3b08f-93ed-4db5-bd77-09c6e9e5c6fc tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:28.815176 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-33c3b08f-93ed-4db5-bd77-09c6e9e5c6fc tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:28.815746 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-33c3b08f-93ed-4db5-bd77-09c6e9e5c6fc tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:28.819724 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-33c3b08f-93ed-4db5-bd77-09c6e9e5c6fc tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:28.820488 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-33c3b08f-93ed-4db5-bd77-09c6e9e5c6fc tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:28.832007 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-3bec8459-4e34-409d-b4df-28f541d0d340 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:28.838463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-33c3b08f-93ed-4db5-bd77-09c6e9e5c6fc tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] HTTP exception thrown: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:28.839764 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3bec8459-4e34-409d-b4df-28f541d0d340 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1503 microversion: 2.1 time: 0.175555 Jun 26 03:06:28.840330 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 153/314] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:28 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-33c3b08f-93ed-4db5-bd77-09c6e9e5c6fc tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Request method failure captured: Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: DELETE /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a HTTP/1.1 Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zRh8Qb_pJf5JzW5ezA-d7dTrGPFdCJDLzvI6AaIh3kadwjIYGl4g5pDWJf01n2WCKujiGtrQdrxBUBsQgv8088NLkdBXlbQB1wiXdxfi67oDE8_MZnRS1bLo0dj3cclIHMnwt12tXQjoXMjlZ00lcz_w82bXvYNdW8kH2EZbdErxc Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 23078d86cd394c749328fb9dd7992919 Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-DeleteServersTestJSON-20252491 Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:06:28.841393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:06:28.843255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_23078d86cd394c749328fb9dd7992919"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/23078d86cd394c749328fb9dd7992919"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23078d86cd394c749328fb9dd7992919"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23078d86cd394c749328fb9dd7992919"}]}] Jun 26 03:06:28.843255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-DeleteServersTestJSON-20252491 Jun 26 03:06:28.843255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 23078d86cd394c749328fb9dd7992919 Jun 26 03:06:28.843255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-DeleteServersTestJSON-20252491 Jun 26 03:06:28.843255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-DeleteServersTestJSON-20252491-project Jun 26 03:06:28.843255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:06:28.843255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:06:28.843255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 99e31454d9aa47f38f09f016399f9b86 Jun 26 03:06:28.843255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-DeleteServersTestJSON-20252491-project Jun 26 03:06:28.843255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:06:28.843255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:28.843255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a'} Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:06:28.843890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:28.844920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:28.847771 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-33c3b08f-93ed-4db5-bd77-09c6e9e5c6fc tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Returning 404 to user: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:06:28.848837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-33c3b08f-93ed-4db5-bd77-09c6e9e5c6fc tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 404 len: 111 microversion: 2.1 time: 0.046812 Jun 26 03:06:28.849816 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 162/315] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:06:28 2022] DELETE /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 26 03:06:28.857339 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-bf1ff834-9f59-49ea-8087-5603d993a495 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:28.858108 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-bf1ff834-9f59-49ea-8087-5603d993a495 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] [instance: 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:28.864531 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bf1ff834-9f59-49ea-8087-5603d993a495 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:28.864985 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bf1ff834-9f59-49ea-8087-5603d993a495 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:28.865750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bf1ff834-9f59-49ea-8087-5603d993a495 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:28.866218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bf1ff834-9f59-49ea-8087-5603d993a495 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:28.883726 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-bf1ff834-9f59-49ea-8087-5603d993a495 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] HTTP exception thrown: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-bf1ff834-9f59-49ea-8087-5603d993a495 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Request method failure captured: Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a HTTP/1.1 Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zRh8Qb_pJf5JzW5ezA-d7dTrGPFdCJDLzvI6AaIh3kadwjIYGl4g5pDWJf01n2WCKujiGtrQdrxBUBsQgv8088NLkdBXlbQB1wiXdxfi67oDE8_MZnRS1bLo0dj3cclIHMnwt12tXQjoXMjlZ00lcz_w82bXvYNdW8kH2EZbdErxc Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 23078d86cd394c749328fb9dd7992919 Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-DeleteServersTestJSON-20252491 Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:06:28.885728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:06:28.886948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_23078d86cd394c749328fb9dd7992919"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/23078d86cd394c749328fb9dd7992919"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23078d86cd394c749328fb9dd7992919"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23078d86cd394c749328fb9dd7992919"}]}] Jun 26 03:06:28.886948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-DeleteServersTestJSON-20252491 Jun 26 03:06:28.886948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 23078d86cd394c749328fb9dd7992919 Jun 26 03:06:28.886948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-DeleteServersTestJSON-20252491 Jun 26 03:06:28.886948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-DeleteServersTestJSON-20252491-project Jun 26 03:06:28.886948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:06:28.886948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:06:28.886948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 99e31454d9aa47f38f09f016399f9b86 Jun 26 03:06:28.886948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-DeleteServersTestJSON-20252491-project Jun 26 03:06:28.886948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:06:28.886948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:28.886948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a'} Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:06:28.887609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. Jun 26 03:06:28.888881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:06:28.891328 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-bf1ff834-9f59-49ea-8087-5603d993a495 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] Returning 404 to user: Instance 0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:06:28.892304 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-bf1ff834-9f59-49ea-8087-5603d993a495 tempest-DeleteServersTestJSON-20252491 tempest-DeleteServersTestJSON-20252491-project] 10.222.0.13 "GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a" status: 404 len: 111 microversion: 2.1 time: 0.038887 Jun 26 03:06:28.892991 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 154/316] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:28 2022] GET /compute/v2.1/servers/0e1cf9b3-1e3f-4760-81a4-4f4e8c4d5d7a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 26 03:06:29.515722 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c09904d6-57e7-4aa9-91c7-40d0bab608bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:29.516613 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c09904d6-57e7-4aa9-91c7-40d0bab608bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:29.526198 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c09904d6-57e7-4aa9-91c7-40d0bab608bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:29.527707 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c09904d6-57e7-4aa9-91c7-40d0bab608bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:29.529870 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c09904d6-57e7-4aa9-91c7-40d0bab608bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:29.530728 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c09904d6-57e7-4aa9-91c7-40d0bab608bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:29.856975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-96476548-ff26-4884-8eb4-02ec3723cc37 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:29.858755 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-96476548-ff26-4884-8eb4-02ec3723cc37 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:29.866517 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-96476548-ff26-4884-8eb4-02ec3723cc37 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:29.867131 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-96476548-ff26-4884-8eb4-02ec3723cc37 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:29.868117 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-96476548-ff26-4884-8eb4-02ec3723cc37 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:29.868759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-96476548-ff26-4884-8eb4-02ec3723cc37 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:30.161419 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c09904d6-57e7-4aa9-91c7-40d0bab608bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:30.170704 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c09904d6-57e7-4aa9-91c7-40d0bab608bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.661143 Jun 26 03:06:30.171479 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 163/317] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:29 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:30.281144 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-96476548-ff26-4884-8eb4-02ec3723cc37 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:30.289111 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-96476548-ff26-4884-8eb4-02ec3723cc37 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 200 len: 1503 microversion: 2.1 time: 0.436316 Jun 26 03:06:30.298657 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 155/318] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:29 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 1503 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:30.572080 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-83d6451b-b8d2-4ad3-a918-571c8dabb81b req-a921bbd4-344a-4fff-8c79-87c8d8a99054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "690029c3-471e-45f0-899e-3f57c61ca236", "name": "network-vif-deleted", "tag": "71302763-1081-4376-b087-f298db36489e"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:06:30.603082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-83d6451b-b8d2-4ad3-a918-571c8dabb81b req-a921bbd4-344a-4fff-8c79-87c8d8a99054 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:30.603567 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-83d6451b-b8d2-4ad3-a918-571c8dabb81b req-a921bbd4-344a-4fff-8c79-87c8d8a99054 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:30.607937 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:30.621411 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-83d6451b-b8d2-4ad3-a918-571c8dabb81b req-a921bbd4-344a-4fff-8c79-87c8d8a99054 service nova] Creating event network-vif-deleted:71302763-1081-4376-b087-f298db36489e for instance 690029c3-471e-45f0-899e-3f57c61ca236 on hv-cinder-84684 Jun 26 03:06:30.630962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-83d6451b-b8d2-4ad3-a918-571c8dabb81b req-a921bbd4-344a-4fff-8c79-87c8d8a99054 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065356 Jun 26 03:06:30.632231 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 164/319] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:06:31.187991 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-34257b9f-47fd-4c81-b8f1-e69e934d43b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:31.188585 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-34257b9f-47fd-4c81-b8f1-e69e934d43b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:31.205489 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-34257b9f-47fd-4c81-b8f1-e69e934d43b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:31.205948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-34257b9f-47fd-4c81-b8f1-e69e934d43b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:31.206767 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-34257b9f-47fd-4c81-b8f1-e69e934d43b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:31.207466 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-34257b9f-47fd-4c81-b8f1-e69e934d43b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:31.310590 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ae53655e-c322-42a7-9414-4f6f218d16b3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:31.311526 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ae53655e-c322-42a7-9414-4f6f218d16b3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 690029c3-471e-45f0-899e-3f57c61ca236] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:31.317789 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ae53655e-c322-42a7-9414-4f6f218d16b3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:31.318547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ae53655e-c322-42a7-9414-4f6f218d16b3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:31.319467 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ae53655e-c322-42a7-9414-4f6f218d16b3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:31.320079 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ae53655e-c322-42a7-9414-4f6f218d16b3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:31.334561 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-ae53655e-c322-42a7-9414-4f6f218d16b3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] HTTP exception thrown: Instance 690029c3-471e-45f0-899e-3f57c61ca236 could not be found. Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ae53655e-c322-42a7-9414-4f6f218d16b3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Request method failure captured: Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 HTTP/1.1 Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit80RXeA7t-0tq5HyMfwyt_NyYr9viQ4Bo_pMTxidP4LK2Qp8aGzpHrXspbNIG-OP9-Td4AIrh3mPyWSjFVS3LSRJzBakaaUBn8rMFG4yBOC6XqwRjc4mInbJXK6xLXwr8uxXnB2gh9U03y75RJSKqxdLtnAGyp3kfXEWP4SHsvqoek0 Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 5db904f456b040d8a9f16b169118d21a Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-VolumesActionsTest-1130478683 Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:06:31.336475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:06:31.337699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5db904f456b040d8a9f16b169118d21a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5db904f456b040d8a9f16b169118d21a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5db904f456b040d8a9f16b169118d21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5db904f456b040d8a9f16b169118d21a"}]}] Jun 26 03:06:31.337699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-VolumesActionsTest-1130478683 Jun 26 03:06:31.337699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 5db904f456b040d8a9f16b169118d21a Jun 26 03:06:31.337699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-VolumesActionsTest-1130478683 Jun 26 03:06:31.337699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-VolumesActionsTest-1130478683-project Jun 26 03:06:31.337699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:06:31.337699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:06:31.337699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: c31dbb3dcd9a411ea125573c8189e00c Jun 26 03:06:31.337699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-VolumesActionsTest-1130478683-project Jun 26 03:06:31.337699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:06:31.337699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 690029c3-471e-45f0-899e-3f57c61ca236 could not be found. Jun 26 03:06:31.337699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '690029c3-471e-45f0-899e-3f57c61ca236'} Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 690029c3-471e-45f0-899e-3f57c61ca236 could not be found. Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:06:31.338436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 690029c3-471e-45f0-899e-3f57c61ca236 could not be found. Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 690029c3-471e-45f0-899e-3f57c61ca236 could not be found. Jun 26 03:06:31.339474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:31.342576 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ae53655e-c322-42a7-9414-4f6f218d16b3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Returning 404 to user: Instance 690029c3-471e-45f0-899e-3f57c61ca236 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:06:31.342576 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ae53655e-c322-42a7-9414-4f6f218d16b3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236" status: 404 len: 111 microversion: 2.1 time: 0.034694 Jun 26 03:06:31.342795 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 165/320] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:31 2022] GET /compute/v2.1/servers/690029c3-471e-45f0-899e-3f57c61ca236 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 26 03:06:31.442317 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1087964527", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "networks": [{"uuid": "db8ad85e-89b6-4916-ae2f-7389fbc85f35"}]}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:06:31.467915 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-34257b9f-47fd-4c81-b8f1-e69e934d43b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:31.478444 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-34257b9f-47fd-4c81-b8f1-e69e934d43b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.294091 Jun 26 03:06:31.480924 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 156/321] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:31 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:31.499902 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] validate_networks() for [('db8ad85e-89b6-4916-ae2f-7389fbc85f35', None, None, None, None, None)] {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:06:32.132188 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:06:32.132810 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:06:32.133288 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:06:32.134180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:06:32.134273 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:06:32.144684 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:32.145365 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:32.146530 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:32.146966 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:32.167552 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Getting quotas for project 5db904f456b040d8a9f16b169118d21a. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:06:32.171800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Getting quotas for user c31dbb3dcd9a411ea125573c8189e00c and project 5db904f456b040d8a9f16b169118d21a. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:06:32.192308 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:06:32.194842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:06:32.249151 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-742357af-ba0a-45bf-a16d-c59a5b5188ee tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810210 Jun 26 03:06:32.250330 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 166/322] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:06:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 26 03:06:32.260241 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3d2e8ee3-2ee2-4f21-81f1-2f623705007a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:32.260852 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3d2e8ee3-2ee2-4f21-81f1-2f623705007a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:32.501181 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fde39ca8-5ba2-4519-8481-b287c6b7aabb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:32.504424 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fde39ca8-5ba2-4519-8481-b287c6b7aabb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:32.508251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:32.534800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fde39ca8-5ba2-4519-8481-b287c6b7aabb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:32.535276 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fde39ca8-5ba2-4519-8481-b287c6b7aabb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:32.536098 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fde39ca8-5ba2-4519-8481-b287c6b7aabb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:32.536553 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fde39ca8-5ba2-4519-8481-b287c6b7aabb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:32.538829 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-3d2e8ee3-2ee2-4f21-81f1-2f623705007a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:32.553143 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3d2e8ee3-2ee2-4f21-81f1-2f623705007a tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1214 microversion: 2.1 time: 0.296677 Jun 26 03:06:32.567687 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 157/323] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:32 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1214 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:32.739700 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fde39ca8-5ba2-4519-8481-b287c6b7aabb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:32.750652 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fde39ca8-5ba2-4519-8481-b287c6b7aabb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.255812 Jun 26 03:06:32.759533 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 167/324] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:32 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:33.580620 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d5051be0-1763-4ed6-8499-4bb384649106 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:33.581383 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d5051be0-1763-4ed6-8499-4bb384649106 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:33.595056 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d5051be0-1763-4ed6-8499-4bb384649106 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:33.595509 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d5051be0-1763-4ed6-8499-4bb384649106 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:33.596292 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d5051be0-1763-4ed6-8499-4bb384649106 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:33.596732 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d5051be0-1763-4ed6-8499-4bb384649106 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:33.660867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d5051be0-1763-4ed6-8499-4bb384649106 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:33.668099 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d5051be0-1763-4ed6-8499-4bb384649106 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1218 microversion: 2.1 time: 0.091342 Jun 26 03:06:33.668727 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 158/325] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:33 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:33.769284 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f23e72f8-a680-4d56-9419-10d6d843beac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:33.770089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f23e72f8-a680-4d56-9419-10d6d843beac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:33.776752 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f23e72f8-a680-4d56-9419-10d6d843beac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:33.777215 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f23e72f8-a680-4d56-9419-10d6d843beac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:33.777983 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f23e72f8-a680-4d56-9419-10d6d843beac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:33.778524 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f23e72f8-a680-4d56-9419-10d6d843beac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:33.924887 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f23e72f8-a680-4d56-9419-10d6d843beac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:33.933030 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f23e72f8-a680-4d56-9419-10d6d843beac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.167635 Jun 26 03:06:33.933598 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 168/326] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:33 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:34.684453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1571de5f-dc15-4a95-ac4a-d6d69ff19097 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:34.685062 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1571de5f-dc15-4a95-ac4a-d6d69ff19097 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:34.691726 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1571de5f-dc15-4a95-ac4a-d6d69ff19097 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:34.692169 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1571de5f-dc15-4a95-ac4a-d6d69ff19097 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:34.692930 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1571de5f-dc15-4a95-ac4a-d6d69ff19097 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:34.693360 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1571de5f-dc15-4a95-ac4a-d6d69ff19097 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:34.752748 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1571de5f-dc15-4a95-ac4a-d6d69ff19097 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:34.760637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1571de5f-dc15-4a95-ac4a-d6d69ff19097 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1218 microversion: 2.1 time: 0.079952 Jun 26 03:06:34.761207 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 159/327] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:34 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:34.937316 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9645beb7-98ea-4159-816d-b3e73383f078 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] Action: 'create', calling method: .version_select at 0x7f582c1ec940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-70408212", "metadata": {"Type": "work"}}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:06:34.949626 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a31a7197-925a-4bf4-b53b-b76022bf041d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:34.950281 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a31a7197-925a-4bf4-b53b-b76022bf041d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:34.956971 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a31a7197-925a-4bf4-b53b-b76022bf041d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:34.957431 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a31a7197-925a-4bf4-b53b-b76022bf041d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:34.958240 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a31a7197-925a-4bf4-b53b-b76022bf041d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:34.958680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a31a7197-925a-4bf4-b53b-b76022bf041d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:35.095396 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a31a7197-925a-4bf4-b53b-b76022bf041d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:35.102824 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a31a7197-925a-4bf4-b53b-b76022bf041d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.157126 Jun 26 03:06:35.103382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 160/328] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:34 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:35.217575 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9645beb7-98ea-4159-816d-b3e73383f078 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.396924 Jun 26 03:06:35.218232 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 169/329] 10.222.0.13 () {60 vars in 1155 bytes} [Sun Jun 26 03:06:34 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 399 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 26 03:06:35.228858 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6149adec-10e9-4c05-9627-a3e24302a084 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] Calling method '.version_select at 0x7f582c0a6ca0>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:35.281728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6149adec-10e9-4c05-9627-a3e24302a084 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40" status: 200 len: 351 microversion: 2.1 time: 0.056238 Jun 26 03:06:35.282543 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 161/330] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:06:35 2022] GET /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:06:35.777191 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b24b1669-d128-4553-9ae3-1f5f29d32838 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:35.777718 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b24b1669-d128-4553-9ae3-1f5f29d32838 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:35.784312 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b24b1669-d128-4553-9ae3-1f5f29d32838 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:35.784776 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b24b1669-d128-4553-9ae3-1f5f29d32838 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:35.785519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b24b1669-d128-4553-9ae3-1f5f29d32838 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:35.785954 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b24b1669-d128-4553-9ae3-1f5f29d32838 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:35.844012 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b24b1669-d128-4553-9ae3-1f5f29d32838 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:35.851248 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b24b1669-d128-4553-9ae3-1f5f29d32838 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1266 microversion: 2.1 time: 0.077976 Jun 26 03:06:35.851831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 170/331] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:35 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:36.122148 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8ffd53e2-c89d-4864-bbf0-1a6bbed3a2ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:36.122896 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8ffd53e2-c89d-4864-bbf0-1a6bbed3a2ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:36.131139 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8ffd53e2-c89d-4864-bbf0-1a6bbed3a2ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:36.131932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8ffd53e2-c89d-4864-bbf0-1a6bbed3a2ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:36.132863 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8ffd53e2-c89d-4864-bbf0-1a6bbed3a2ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:36.133459 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8ffd53e2-c89d-4864-bbf0-1a6bbed3a2ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:36.265649 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8ffd53e2-c89d-4864-bbf0-1a6bbed3a2ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:36.273083 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8ffd53e2-c89d-4864-bbf0-1a6bbed3a2ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.156416 Jun 26 03:06:36.273644 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 162/332] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:36 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:36.294191 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-52ab5bb6-7dd4-4804-aee4-694ef137a90c tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] Calling method '.version_select at 0x7f582c316670>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:36.339726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-52ab5bb6-7dd4-4804-aee4-694ef137a90c tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40" status: 200 len: 351 microversion: 2.1 time: 0.049388 Jun 26 03:06:36.340284 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 171/333] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:06:36 2022] GET /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:06:36.867929 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-54dd8c33-bca8-452d-85ec-5b7ae4237925 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:36.868754 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-54dd8c33-bca8-452d-85ec-5b7ae4237925 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:36.874702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-54dd8c33-bca8-452d-85ec-5b7ae4237925 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:36.875152 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-54dd8c33-bca8-452d-85ec-5b7ae4237925 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:36.875915 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-54dd8c33-bca8-452d-85ec-5b7ae4237925 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:36.876349 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-54dd8c33-bca8-452d-85ec-5b7ae4237925 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:36.941757 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-54dd8c33-bca8-452d-85ec-5b7ae4237925 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:36.949881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-54dd8c33-bca8-452d-85ec-5b7ae4237925 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1274 microversion: 2.1 time: 0.085795 Jun 26 03:06:36.950469 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 163/334] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:36 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:37.288921 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a6ceb6fc-d4ac-4595-a5ba-34f0b292388c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:37.289619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a6ceb6fc-d4ac-4595-a5ba-34f0b292388c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:37.296258 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a6ceb6fc-d4ac-4595-a5ba-34f0b292388c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:37.296827 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a6ceb6fc-d4ac-4595-a5ba-34f0b292388c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:37.297456 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a6ceb6fc-d4ac-4595-a5ba-34f0b292388c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:37.297896 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a6ceb6fc-d4ac-4595-a5ba-34f0b292388c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:37.352164 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9b745266-8190-4462-82db-d76ef014ca34 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] Calling method '.version_select at 0x7f582c0ac310>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:37.400444 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9b745266-8190-4462-82db-d76ef014ca34 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40" status: 200 len: 352 microversion: 2.1 time: 0.052145 Jun 26 03:06:37.401219 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 164/335] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:06:37 2022] GET /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:06:37.412024 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c55d5aca-967d-40fa-9eef-d3e777545255 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] Calling method '.version_select at 0x7f582cc294c0>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:37.426799 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a6ceb6fc-d4ac-4595-a5ba-34f0b292388c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:37.434459 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a6ceb6fc-d4ac-4595-a5ba-34f0b292388c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.149794 Jun 26 03:06:37.435022 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 172/336] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:37 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:37.459523 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c55d5aca-967d-40fa-9eef-d3e777545255 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40" status: 200 len: 352 microversion: 2.1 time: 0.051076 Jun 26 03:06:37.460769 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 165/337] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:06:37 2022] GET /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:06:37.476444 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-47ce5ed9-4c57-4ccd-86e0-fc53bca273b6 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] Calling method '.version_select at 0x7f582c0bd3a0>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:37.535874 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-47ce5ed9-4c57-4ccd-86e0-fc53bca273b6 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40" status: 202 len: 0 microversion: 2.1 time: 0.063132 Jun 26 03:06:37.536430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 173/338] 10.222.0.13 () {58 vars in 1247 bytes} [Sun Jun 26 03:06:37 2022] DELETE /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:06:37.544399 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b189ca2b-3158-4c71-b781-dbd00a156f13 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] Calling method '.version_select at 0x7f582c0a6040>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:37.593586 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b189ca2b-3158-4c71-b781-dbd00a156f13 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40" status: 200 len: 351 microversion: 2.1 time: 0.052958 Jun 26 03:06:37.594165 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 166/339] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:06:37 2022] GET /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:06:37.967152 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-39f2dd53-4889-4d05-a143-c97731da426b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:37.967792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-39f2dd53-4889-4d05-a143-c97731da426b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:37.973764 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-39f2dd53-4889-4d05-a143-c97731da426b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:37.974254 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-39f2dd53-4889-4d05-a143-c97731da426b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:37.975023 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-39f2dd53-4889-4d05-a143-c97731da426b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:37.975468 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-39f2dd53-4889-4d05-a143-c97731da426b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:38.054370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-39f2dd53-4889-4d05-a143-c97731da426b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:38.062312 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-39f2dd53-4889-4d05-a143-c97731da426b tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1272 microversion: 2.1 time: 0.099124 Jun 26 03:06:38.063069 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 174/340] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:37 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:38.451053 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-36b9fcf9-3acc-4bd4-b875-159f00f72994 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:38.452932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-36b9fcf9-3acc-4bd4-b875-159f00f72994 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:38.462528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-36b9fcf9-3acc-4bd4-b875-159f00f72994 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:38.463281 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-36b9fcf9-3acc-4bd4-b875-159f00f72994 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:38.465572 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-36b9fcf9-3acc-4bd4-b875-159f00f72994 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:38.466289 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-36b9fcf9-3acc-4bd4-b875-159f00f72994 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:38.607694 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b1dd86df-8eaa-4d93-bffd-08833924a257 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] Calling method '.version_select at 0x7f582c0bd040>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:38.651590 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-b1dd86df-8eaa-4d93-bffd-08833924a257 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] HTTP exception thrown: Volume 8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 could not be found. Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b1dd86df-8eaa-4d93-bffd-08833924a257 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] Request method failure captured: Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 HTTP/1.1 Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit806wu8SFZZQeLrl0YwrHjKNQnKcdSVs8dksIOBBQ7ZXmLxs0MdduNVO5EF85zQeyrqqfA5VMPTdDiwWWhIhGhUk30pCYj-medLmYhPaBgLumFzI53D4EaQ0A_XzOlr70PzV9kk8l0RPPeaPC4a_lERb5pOM0jvsaUYsHy8aat7PRVo Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: c3bb6f4e883b42d597f734463d219f21 Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-VolumesGetTestJSON-1758612759 Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:06:38.656115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:06:38.657688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c3bb6f4e883b42d597f734463d219f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c3bb6f4e883b42d597f734463d219f21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c3bb6f4e883b42d597f734463d219f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c3bb6f4e883b42d597f734463d219f21"}]}] Jun 26 03:06:38.657688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-VolumesGetTestJSON-1758612759 Jun 26 03:06:38.657688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: c3bb6f4e883b42d597f734463d219f21 Jun 26 03:06:38.657688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-VolumesGetTestJSON-1758612759 Jun 26 03:06:38.657688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-VolumesGetTestJSON-1758612759-project Jun 26 03:06:38.657688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:06:38.657688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:06:38.657688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: b700a67b0ba241bca89b74f13c50cc4a Jun 26 03:06:38.657688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-VolumesGetTestJSON-1758612759-project Jun 26 03:06:38.657688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: Jun 26 03:06:38.657688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Volume 8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 could not be found. Jun 26 03:06:38.657688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '8ea3bb9a-3c57-4c34-b217-ab8ce7904c40'} Jun 26 03:06:38.657688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 could not be found. (HTTP 404) (Request-ID: req-3dac9aee-b80b-43fd-babe-976a577cae02) Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:38.658632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 26 03:06:38.660177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 could not be found. Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 26 03:06:38.661334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 could not be found. Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 could not be found. Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b1dd86df-8eaa-4d93-bffd-08833924a257 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] Returning 404 to user: Volume 8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b1dd86df-8eaa-4d93-bffd-08833924a257 tempest-VolumesGetTestJSON-1758612759 tempest-VolumesGetTestJSON-1758612759-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40" status: 404 len: 109 microversion: 2.1 time: 0.058359 Jun 26 03:06:38.663162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 175/341] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:06:38 2022] GET /compute/v2.1/os-volumes/8ea3bb9a-3c57-4c34-b217-ab8ce7904c40 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:06:38.763428 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-36b9fcf9-3acc-4bd4-b875-159f00f72994 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:38.774236 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-36b9fcf9-3acc-4bd4-b875-159f00f72994 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.327062 Jun 26 03:06:38.775245 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 167/342] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:38 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:39.079749 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-131e025d-7502-4fb3-84ab-a7c896ba15c1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:39.080358 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-131e025d-7502-4fb3-84ab-a7c896ba15c1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:39.087259 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-131e025d-7502-4fb3-84ab-a7c896ba15c1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:39.087707 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-131e025d-7502-4fb3-84ab-a7c896ba15c1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:39.088478 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-131e025d-7502-4fb3-84ab-a7c896ba15c1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:39.088974 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-131e025d-7502-4fb3-84ab-a7c896ba15c1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:39.419753 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-131e025d-7502-4fb3-84ab-a7c896ba15c1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:39.440001 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-131e025d-7502-4fb3-84ab-a7c896ba15c1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1314 microversion: 2.1 time: 0.364580 Jun 26 03:06:39.440608 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 176/343] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:39 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:39.691500 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-99bd1dc3-16e5-4dc1-9e18-a98e3217fe9d req-45f1aaad-b228-4b74-9c0a-123c4bc82fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9254ca08-5ad0-4213-b2f3-e2dc9cd0478d", "tag": "5e55dfc0-0f98-4349-8cf3-8adbf7c34b73"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:06:39.705895 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-99bd1dc3-16e5-4dc1-9e18-a98e3217fe9d req-45f1aaad-b228-4b74-9c0a-123c4bc82fc7 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:39.707180 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-99bd1dc3-16e5-4dc1-9e18-a98e3217fe9d req-45f1aaad-b228-4b74-9c0a-123c4bc82fc7 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:39.722829 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-99bd1dc3-16e5-4dc1-9e18-a98e3217fe9d req-45f1aaad-b228-4b74-9c0a-123c4bc82fc7 service nova] Creating event network-changed:5e55dfc0-0f98-4349-8cf3-8adbf7c34b73 for instance 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d on hv-cinder-84684 Jun 26 03:06:39.729956 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-99bd1dc3-16e5-4dc1-9e18-a98e3217fe9d req-45f1aaad-b228-4b74-9c0a-123c4bc82fc7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044124 Jun 26 03:06:39.731179 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 168/344] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:06:39.792833 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4d4a0b72-2e28-4eeb-a98d-2d4054cac607 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:39.793652 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4d4a0b72-2e28-4eeb-a98d-2d4054cac607 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:39.801642 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d4a0b72-2e28-4eeb-a98d-2d4054cac607 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:39.803483 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d4a0b72-2e28-4eeb-a98d-2d4054cac607 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:39.804466 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d4a0b72-2e28-4eeb-a98d-2d4054cac607 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:39.804916 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d4a0b72-2e28-4eeb-a98d-2d4054cac607 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:39.956190 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4d4a0b72-2e28-4eeb-a98d-2d4054cac607 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:39.966693 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4d4a0b72-2e28-4eeb-a98d-2d4054cac607 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1521 microversion: 2.1 time: 0.179248 Jun 26 03:06:39.969845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 177/345] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:39 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:40.458466 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9b15d5ab-d54d-4c50-9c3d-109d29dd53e9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:40.459496 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9b15d5ab-d54d-4c50-9c3d-109d29dd53e9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:40.469436 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9b15d5ab-d54d-4c50-9c3d-109d29dd53e9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:40.469876 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9b15d5ab-d54d-4c50-9c3d-109d29dd53e9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:40.471676 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9b15d5ab-d54d-4c50-9c3d-109d29dd53e9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:40.472401 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9b15d5ab-d54d-4c50-9c3d-109d29dd53e9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:40.715208 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9b15d5ab-d54d-4c50-9c3d-109d29dd53e9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:40.722905 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9b15d5ab-d54d-4c50-9c3d-109d29dd53e9 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1314 microversion: 2.1 time: 0.268969 Jun 26 03:06:40.733438 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 169/346] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:40 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:40.986293 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f29e96ab-adfc-4cf7-99c6-2070b6187840 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:40.986886 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f29e96ab-adfc-4cf7-99c6-2070b6187840 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:40.993497 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f29e96ab-adfc-4cf7-99c6-2070b6187840 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:40.993954 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f29e96ab-adfc-4cf7-99c6-2070b6187840 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:40.994771 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f29e96ab-adfc-4cf7-99c6-2070b6187840 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:40.995386 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f29e96ab-adfc-4cf7-99c6-2070b6187840 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:41.141359 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f29e96ab-adfc-4cf7-99c6-2070b6187840 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:41.152091 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f29e96ab-adfc-4cf7-99c6-2070b6187840 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1501 microversion: 2.1 time: 0.170253 Jun 26 03:06:41.152926 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 178/347] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:40 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:41.171021 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b4de9ea6-b05a-4d30-b186-86fbf819cbe2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:41.171640 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b4de9ea6-b05a-4d30-b186-86fbf819cbe2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:41.187493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b4de9ea6-b05a-4d30-b186-86fbf819cbe2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:41.187953 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b4de9ea6-b05a-4d30-b186-86fbf819cbe2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:41.188729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b4de9ea6-b05a-4d30-b186-86fbf819cbe2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:41.189170 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b4de9ea6-b05a-4d30-b186-86fbf819cbe2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:41.338405 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b4de9ea6-b05a-4d30-b186-86fbf819cbe2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:41.346515 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b4de9ea6-b05a-4d30-b186-86fbf819cbe2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1516 microversion: 2.1 time: 0.179959 Jun 26 03:06:41.358260 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 170/348] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:41 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:41.739943 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e00773fc-106a-4e32-826a-ac32a5d0a825 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:41.741085 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e00773fc-106a-4e32-826a-ac32a5d0a825 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:41.747653 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e00773fc-106a-4e32-826a-ac32a5d0a825 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:41.748720 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e00773fc-106a-4e32-826a-ac32a5d0a825 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:41.749363 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e00773fc-106a-4e32-826a-ac32a5d0a825 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:41.750233 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e00773fc-106a-4e32-826a-ac32a5d0a825 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:41.908516 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e00773fc-106a-4e32-826a-ac32a5d0a825 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:41.916785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e00773fc-106a-4e32-826a-ac32a5d0a825 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1314 microversion: 2.1 time: 0.180840 Jun 26 03:06:41.917356 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 179/349] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:41 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:42.794427 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2f2005e3-fce8-46fa-8923-109f65046e1f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:06:42.796492 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2f2005e3-fce8-46fa-8923-109f65046e1f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:42.802530 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=2 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:42.804343 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2f2005e3-fce8-46fa-8923-109f65046e1f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:42.805026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2f2005e3-fce8-46fa-8923-109f65046e1f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:42.806019 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2f2005e3-fce8-46fa-8923-109f65046e1f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:42.806755 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2f2005e3-fce8-46fa-8923-109f65046e1f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:42.830941 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-2f2005e3-fce8-46fa-8923-109f65046e1f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lazy-loading 'flavor' on Instance uuid cddc852a-2aa2-4a44-ad1a-e9e930e3bddf {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:06:42.926183 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2f2005e3-fce8-46fa-8923-109f65046e1f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "POST /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf/action" status: 200 len: 32 microversion: 2.1 time: 0.135504 Jun 26 03:06:42.927215 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 171/350] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:06:42 2022] POST /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf/action => generated 32 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 26 03:06:42.937687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8f4b9d65-3d6c-45c4-8de3-3bc75bd79ddd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:42.938377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8f4b9d65-3d6c-45c4-8de3-3bc75bd79ddd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:42.946443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=2 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:42.949855 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=6 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:42.957309 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6d16df49-3fbb-4e1d-8af9-3f6c5bf7c6fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:42.958574 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-6d16df49-3fbb-4e1d-8af9-3f6c5bf7c6fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:42.961770 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8f4b9d65-3d6c-45c4-8de3-3bc75bd79ddd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:42.962445 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8f4b9d65-3d6c-45c4-8de3-3bc75bd79ddd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:42.963901 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8f4b9d65-3d6c-45c4-8de3-3bc75bd79ddd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:42.964606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8f4b9d65-3d6c-45c4-8de3-3bc75bd79ddd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:42.967991 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6d16df49-3fbb-4e1d-8af9-3f6c5bf7c6fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:42.968735 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6d16df49-3fbb-4e1d-8af9-3f6c5bf7c6fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:42.969717 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6d16df49-3fbb-4e1d-8af9-3f6c5bf7c6fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:42.970532 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6d16df49-3fbb-4e1d-8af9-3f6c5bf7c6fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:43.204478 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-8f4b9d65-3d6c-45c4-8de3-3bc75bd79ddd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:43.209351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-6d16df49-3fbb-4e1d-8af9-3f6c5bf7c6fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:43.217857 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6d16df49-3fbb-4e1d-8af9-3f6c5bf7c6fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.271878 Jun 26 03:06:43.218711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 172/351] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:42 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:43.227790 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8f4b9d65-3d6c-45c4-8de3-3bc75bd79ddd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1314 microversion: 2.1 time: 0.293914 Jun 26 03:06:43.227790 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 180/352] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:42 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:44.240280 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-00d30ecc-b730-452c-bfa6-03a8d634ee33 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:44.242319 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-00d30ecc-b730-452c-bfa6-03a8d634ee33 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:44.243391 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-98912193-ea56-4a6c-9c7a-182cc7bbcedd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:44.244002 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-98912193-ea56-4a6c-9c7a-182cc7bbcedd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:44.253531 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00d30ecc-b730-452c-bfa6-03a8d634ee33 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:44.253693 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-98912193-ea56-4a6c-9c7a-182cc7bbcedd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:44.254162 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-98912193-ea56-4a6c-9c7a-182cc7bbcedd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:44.254600 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00d30ecc-b730-452c-bfa6-03a8d634ee33 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:44.254943 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-98912193-ea56-4a6c-9c7a-182cc7bbcedd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:44.255383 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-98912193-ea56-4a6c-9c7a-182cc7bbcedd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:44.256169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00d30ecc-b730-452c-bfa6-03a8d634ee33 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:44.256814 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00d30ecc-b730-452c-bfa6-03a8d634ee33 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:44.706810 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-98912193-ea56-4a6c-9c7a-182cc7bbcedd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:44.713163 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:44.720885 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-98912193-ea56-4a6c-9c7a-182cc7bbcedd tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1314 microversion: 2.1 time: 0.479854 Jun 26 03:06:44.731466 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 173/353] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:44 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:44.841938 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-00d30ecc-b730-452c-bfa6-03a8d634ee33 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:44.862083 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-00d30ecc-b730-452c-bfa6-03a8d634ee33 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.629413 Jun 26 03:06:44.862980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 181/354] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:44 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:45.667892 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-8101d7b9-9174-4bb0-8ca7-17a56fc854a1 req-b4dfa24e-ef0c-4fee-9961-cd134a93157b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9254ca08-5ad0-4213-b2f3-e2dc9cd0478d", "name": "network-vif-plugged", "status": "completed", "tag": "5e55dfc0-0f98-4349-8cf3-8adbf7c34b73"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:06:45.681651 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-8101d7b9-9174-4bb0-8ca7-17a56fc854a1 req-b4dfa24e-ef0c-4fee-9961-cd134a93157b service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:45.682548 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-8101d7b9-9174-4bb0-8ca7-17a56fc854a1 req-b4dfa24e-ef0c-4fee-9961-cd134a93157b service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:45.697304 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-8101d7b9-9174-4bb0-8ca7-17a56fc854a1 req-b4dfa24e-ef0c-4fee-9961-cd134a93157b service nova] Creating event network-vif-plugged:5e55dfc0-0f98-4349-8cf3-8adbf7c34b73 for instance 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d on hv-cinder-84684 Jun 26 03:06:45.703543 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-8101d7b9-9174-4bb0-8ca7-17a56fc854a1 req-b4dfa24e-ef0c-4fee-9961-cd134a93157b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039841 Jun 26 03:06:45.704720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 174/355] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:06:45.738321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-77c810d4-1dfd-4fe2-941d-9edc8c6bbba5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:45.738941 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-77c810d4-1dfd-4fe2-941d-9edc8c6bbba5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:45.745308 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-77c810d4-1dfd-4fe2-941d-9edc8c6bbba5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:45.746026 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-77c810d4-1dfd-4fe2-941d-9edc8c6bbba5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:45.747048 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-77c810d4-1dfd-4fe2-941d-9edc8c6bbba5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:45.747708 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-77c810d4-1dfd-4fe2-941d-9edc8c6bbba5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:45.880186 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6899e231-e834-4d68-9c9b-0e9dad32125f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:45.881203 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-6899e231-e834-4d68-9c9b-0e9dad32125f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:45.888044 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6899e231-e834-4d68-9c9b-0e9dad32125f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:45.888829 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6899e231-e834-4d68-9c9b-0e9dad32125f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:45.889759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6899e231-e834-4d68-9c9b-0e9dad32125f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:45.890406 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6899e231-e834-4d68-9c9b-0e9dad32125f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:45.912247 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-77c810d4-1dfd-4fe2-941d-9edc8c6bbba5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:45.921720 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-77c810d4-1dfd-4fe2-941d-9edc8c6bbba5 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1314 microversion: 2.1 time: 0.187187 Jun 26 03:06:45.922550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 182/356] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:45 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:46.062170 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-6899e231-e834-4d68-9c9b-0e9dad32125f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:46.069681 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6899e231-e834-4d68-9c9b-0e9dad32125f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.193905 Jun 26 03:06:46.070283 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 175/357] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:45 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:46.938429 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c42a1fc3-788f-4a81-a046-cd17ae3453e3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:46.938983 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c42a1fc3-788f-4a81-a046-cd17ae3453e3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:46.945319 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c42a1fc3-788f-4a81-a046-cd17ae3453e3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:46.945825 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c42a1fc3-788f-4a81-a046-cd17ae3453e3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:46.946692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c42a1fc3-788f-4a81-a046-cd17ae3453e3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:46.947125 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c42a1fc3-788f-4a81-a046-cd17ae3453e3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:47.089542 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d528b947-4046-4a93-a931-ee431f7221dd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:47.091194 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d528b947-4046-4a93-a931-ee431f7221dd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:47.094205 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c42a1fc3-788f-4a81-a046-cd17ae3453e3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:47.099561 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d528b947-4046-4a93-a931-ee431f7221dd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:47.100304 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d528b947-4046-4a93-a931-ee431f7221dd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:47.101423 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d528b947-4046-4a93-a931-ee431f7221dd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:47.101784 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d528b947-4046-4a93-a931-ee431f7221dd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:47.102879 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c42a1fc3-788f-4a81-a046-cd17ae3453e3 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1314 microversion: 2.1 time: 0.168675 Jun 26 03:06:47.103615 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 183/358] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:46 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:47.228403 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d528b947-4046-4a93-a931-ee431f7221dd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:47.236281 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d528b947-4046-4a93-a931-ee431f7221dd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.150812 Jun 26 03:06:47.236788 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 176/359] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:47 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:48.120294 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-05cb9d09-2466-444c-8ddf-a6f9a095388e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:48.120908 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-05cb9d09-2466-444c-8ddf-a6f9a095388e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:48.128516 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-05cb9d09-2466-444c-8ddf-a6f9a095388e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:48.128965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-05cb9d09-2466-444c-8ddf-a6f9a095388e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:48.129754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-05cb9d09-2466-444c-8ddf-a6f9a095388e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:48.130170 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-05cb9d09-2466-444c-8ddf-a6f9a095388e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:48.254098 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e35c1876-af3c-45cf-bb4e-f8d16c3ac677 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:48.255473 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e35c1876-af3c-45cf-bb4e-f8d16c3ac677 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:48.262451 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e35c1876-af3c-45cf-bb4e-f8d16c3ac677 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:48.263267 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e35c1876-af3c-45cf-bb4e-f8d16c3ac677 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:48.264612 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e35c1876-af3c-45cf-bb4e-f8d16c3ac677 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:48.265149 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e35c1876-af3c-45cf-bb4e-f8d16c3ac677 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:48.266848 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-05cb9d09-2466-444c-8ddf-a6f9a095388e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:48.274269 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-05cb9d09-2466-444c-8ddf-a6f9a095388e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1314 microversion: 2.1 time: 0.157740 Jun 26 03:06:48.275030 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 184/360] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:48 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:48.399242 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e35c1876-af3c-45cf-bb4e-f8d16c3ac677 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:48.408573 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e35c1876-af3c-45cf-bb4e-f8d16c3ac677 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.159667 Jun 26 03:06:48.410092 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 177/361] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:48 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:49.291423 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-94c521c7-3cb4-48c8-b0e7-3dc81c917b64 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:49.292044 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-94c521c7-3cb4-48c8-b0e7-3dc81c917b64 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:49.298720 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-94c521c7-3cb4-48c8-b0e7-3dc81c917b64 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:49.299174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-94c521c7-3cb4-48c8-b0e7-3dc81c917b64 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:49.300000 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-94c521c7-3cb4-48c8-b0e7-3dc81c917b64 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:49.300442 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-94c521c7-3cb4-48c8-b0e7-3dc81c917b64 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:49.426600 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ba3b005e-6856-4541-a5a7-c20ba11acbc2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:49.427215 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ba3b005e-6856-4541-a5a7-c20ba11acbc2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:49.434244 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ba3b005e-6856-4541-a5a7-c20ba11acbc2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:49.434620 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-94c521c7-3cb4-48c8-b0e7-3dc81c917b64 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:49.434764 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ba3b005e-6856-4541-a5a7-c20ba11acbc2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:49.435654 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ba3b005e-6856-4541-a5a7-c20ba11acbc2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:49.436156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ba3b005e-6856-4541-a5a7-c20ba11acbc2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:49.442999 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-94c521c7-3cb4-48c8-b0e7-3dc81c917b64 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1497 microversion: 2.1 time: 0.155453 Jun 26 03:06:49.443582 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 185/362] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:49 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:49.582939 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ba3b005e-6856-4541-a5a7-c20ba11acbc2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:49.590979 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ba3b005e-6856-4541-a5a7-c20ba11acbc2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.168359 Jun 26 03:06:49.591547 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 178/363] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:49 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:49.974539 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-88203e19-c040-4ab1-adf9-8e48ed7bc284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:49.975067 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-88203e19-c040-4ab1-adf9-8e48ed7bc284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:49.981063 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-88203e19-c040-4ab1-adf9-8e48ed7bc284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:49.981524 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-88203e19-c040-4ab1-adf9-8e48ed7bc284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:49.982365 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-88203e19-c040-4ab1-adf9-8e48ed7bc284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:49.982810 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-88203e19-c040-4ab1-adf9-8e48ed7bc284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:50.008645 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-88203e19-c040-4ab1-adf9-8e48ed7bc284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:06:50.011452 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=100 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:50.088518 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-88203e19-c040-4ab1-adf9-8e48ed7bc284 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 204 len: 0 microversion: 2.1 time: 0.117474 Jun 26 03:06:50.089041 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 186/364] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:06:49 2022] DELETE /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:06:50.097687 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3ba46829-fda2-4a30-a51c-b380f81f59b1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:50.098655 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3ba46829-fda2-4a30-a51c-b380f81f59b1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:50.104963 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3ba46829-fda2-4a30-a51c-b380f81f59b1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:50.105522 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3ba46829-fda2-4a30-a51c-b380f81f59b1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:50.106447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3ba46829-fda2-4a30-a51c-b380f81f59b1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:50.106979 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3ba46829-fda2-4a30-a51c-b380f81f59b1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:50.237165 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-3ba46829-fda2-4a30-a51c-b380f81f59b1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:50.244574 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3ba46829-fda2-4a30-a51c-b380f81f59b1 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1503 microversion: 2.1 time: 0.150802 Jun 26 03:06:50.245133 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 179/365] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:50 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:50.607166 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-5b9b7f92-c829-4aa3-b8cc-5056dc273709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:50.607874 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-5b9b7f92-c829-4aa3-b8cc-5056dc273709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:50.614407 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5b9b7f92-c829-4aa3-b8cc-5056dc273709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:50.615018 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5b9b7f92-c829-4aa3-b8cc-5056dc273709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:50.615964 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5b9b7f92-c829-4aa3-b8cc-5056dc273709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:50.616534 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5b9b7f92-c829-4aa3-b8cc-5056dc273709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:50.752563 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-5b9b7f92-c829-4aa3-b8cc-5056dc273709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:50.760134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-5b9b7f92-c829-4aa3-b8cc-5056dc273709 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.157102 Jun 26 03:06:50.760694 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 187/366] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:50 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:51.262448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5686b4b8-c11f-4b47-9486-a4a1e1315960 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:51.263157 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5686b4b8-c11f-4b47-9486-a4a1e1315960 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:51.269704 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5686b4b8-c11f-4b47-9486-a4a1e1315960 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:51.270183 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5686b4b8-c11f-4b47-9486-a4a1e1315960 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:51.270944 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5686b4b8-c11f-4b47-9486-a4a1e1315960 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:51.271373 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5686b4b8-c11f-4b47-9486-a4a1e1315960 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:51.396320 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5686b4b8-c11f-4b47-9486-a4a1e1315960 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:51.403736 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5686b4b8-c11f-4b47-9486-a4a1e1315960 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1503 microversion: 2.1 time: 0.145291 Jun 26 03:06:51.404304 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 180/367] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:51 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1503 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:51.777179 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-578484e5-efae-4a6c-b1d6-cecaa7051cb8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:51.777891 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-578484e5-efae-4a6c-b1d6-cecaa7051cb8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:51.785024 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-578484e5-efae-4a6c-b1d6-cecaa7051cb8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:51.785474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-578484e5-efae-4a6c-b1d6-cecaa7051cb8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:51.786261 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-578484e5-efae-4a6c-b1d6-cecaa7051cb8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:51.786695 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-578484e5-efae-4a6c-b1d6-cecaa7051cb8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:51.985643 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-578484e5-efae-4a6c-b1d6-cecaa7051cb8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:51.993145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-578484e5-efae-4a6c-b1d6-cecaa7051cb8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.219761 Jun 26 03:06:51.993713 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 188/368] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:51 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:52.339132 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-7a100105-a4a0-4b1d-b4c5-a50ebe65f6f5 req-06297150-efc6-4ace-a8af-88ade79726a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9254ca08-5ad0-4213-b2f3-e2dc9cd0478d", "name": "network-vif-deleted", "tag": "5e55dfc0-0f98-4349-8cf3-8adbf7c34b73"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:06:52.347951 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-7a100105-a4a0-4b1d-b4c5-a50ebe65f6f5 req-06297150-efc6-4ace-a8af-88ade79726a4 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:52.348266 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-7a100105-a4a0-4b1d-b4c5-a50ebe65f6f5 req-06297150-efc6-4ace-a8af-88ade79726a4 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:52.361677 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-7a100105-a4a0-4b1d-b4c5-a50ebe65f6f5 req-06297150-efc6-4ace-a8af-88ade79726a4 service nova] Creating event network-vif-deleted:5e55dfc0-0f98-4349-8cf3-8adbf7c34b73 for instance 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d on hv-cinder-84684 Jun 26 03:06:52.366799 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-7a100105-a4a0-4b1d-b4c5-a50ebe65f6f5 req-06297150-efc6-4ace-a8af-88ade79726a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031132 Jun 26 03:06:52.367405 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 181/369] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:06:52.421162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ac5c0b5e-1da2-4f2d-b45f-22ebef531571 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:52.421876 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ac5c0b5e-1da2-4f2d-b45f-22ebef531571 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:52.428546 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac5c0b5e-1da2-4f2d-b45f-22ebef531571 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:52.429816 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac5c0b5e-1da2-4f2d-b45f-22ebef531571 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:52.430630 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac5c0b5e-1da2-4f2d-b45f-22ebef531571 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:52.431242 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac5c0b5e-1da2-4f2d-b45f-22ebef531571 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:52.496248 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ac5c0b5e-1da2-4f2d-b45f-22ebef531571 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31dbb3dcd9a411ea125573c8189e00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db904f456b040d8a9f16b169118d21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:52.506160 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ac5c0b5e-1da2-4f2d-b45f-22ebef531571 tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 200 len: 1299 microversion: 2.1 time: 0.089153 Jun 26 03:06:52.514230 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 189/370] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:52 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:53.010773 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-98ef41d8-c278-4390-a5a7-a16c168b63b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:53.011385 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-98ef41d8-c278-4390-a5a7-a16c168b63b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:53.017437 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-98ef41d8-c278-4390-a5a7-a16c168b63b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:53.017888 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-98ef41d8-c278-4390-a5a7-a16c168b63b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:53.018680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-98ef41d8-c278-4390-a5a7-a16c168b63b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:53.019109 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-98ef41d8-c278-4390-a5a7-a16c168b63b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:53.151140 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-98ef41d8-c278-4390-a5a7-a16c168b63b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:53.158984 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-98ef41d8-c278-4390-a5a7-a16c168b63b3 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.152688 Jun 26 03:06:53.159540 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 182/371] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:53 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:53.522658 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0bbf64f0-a399-40e5-a8d7-51c313eedb1e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:53.523309 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0bbf64f0-a399-40e5-a8d7-51c313eedb1e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] [instance: 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:53.529847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0bbf64f0-a399-40e5-a8d7-51c313eedb1e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:53.530334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0bbf64f0-a399-40e5-a8d7-51c313eedb1e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:53.531096 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0bbf64f0-a399-40e5-a8d7-51c313eedb1e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:53.531538 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0bbf64f0-a399-40e5-a8d7-51c313eedb1e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:53.547367 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-0bbf64f0-a399-40e5-a8d7-51c313eedb1e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] HTTP exception thrown: Instance 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d could not be found. Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0bbf64f0-a399-40e5-a8d7-51c313eedb1e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Request method failure captured: Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d HTTP/1.1 Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit80RXeA7t-0tq5HyMfwyt_NyYr9viQ4Bo_pMTxidP4LK2Qp8aGzpHrXspbNIG-OP9-Td4AIrh3mPyWSjFVS3LSRJzBakaaUBn8rMFG4yBOC6XqwRjc4mInbJXK6xLXwr8uxXnB2gh9U03y75RJSKqxdLtnAGyp3kfXEWP4SHsvqoek0 Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 5db904f456b040d8a9f16b169118d21a Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-VolumesActionsTest-1130478683 Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:06:53.548979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:06:53.550454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5db904f456b040d8a9f16b169118d21a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5db904f456b040d8a9f16b169118d21a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5db904f456b040d8a9f16b169118d21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5db904f456b040d8a9f16b169118d21a"}]}] Jun 26 03:06:53.550454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-VolumesActionsTest-1130478683 Jun 26 03:06:53.550454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 5db904f456b040d8a9f16b169118d21a Jun 26 03:06:53.550454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-VolumesActionsTest-1130478683 Jun 26 03:06:53.550454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-VolumesActionsTest-1130478683-project Jun 26 03:06:53.550454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:06:53.550454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:06:53.550454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: c31dbb3dcd9a411ea125573c8189e00c Jun 26 03:06:53.550454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-VolumesActionsTest-1130478683-project Jun 26 03:06:53.550454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:06:53.550454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d could not be found. Jun 26 03:06:53.550454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '9254ca08-5ad0-4213-b2f3-e2dc9cd0478d'} Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d could not be found. Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:06:53.551289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d could not be found. Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d could not be found. Jun 26 03:06:53.552687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:06:53.553749 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0bbf64f0-a399-40e5-a8d7-51c313eedb1e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] Returning 404 to user: Instance 9254ca08-5ad0-4213-b2f3-e2dc9cd0478d could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:06:53.553749 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0bbf64f0-a399-40e5-a8d7-51c313eedb1e tempest-VolumesActionsTest-1130478683 tempest-VolumesActionsTest-1130478683-project] 10.222.0.13 "GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d" status: 404 len: 111 microversion: 2.1 time: 0.031570 Jun 26 03:06:53.553749 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 190/372] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:53 2022] GET /compute/v2.1/servers/9254ca08-5ad0-4213-b2f3-e2dc9cd0478d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:06:54.176176 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-20092fb5-7eee-4896-af58-b1d9299ff932 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:54.176792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-20092fb5-7eee-4896-af58-b1d9299ff932 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:54.178825 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=70 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:54.184188 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-20092fb5-7eee-4896-af58-b1d9299ff932 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:54.184645 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-20092fb5-7eee-4896-af58-b1d9299ff932 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:54.185403 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-20092fb5-7eee-4896-af58-b1d9299ff932 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:54.185839 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-20092fb5-7eee-4896-af58-b1d9299ff932 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:54.316956 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-20092fb5-7eee-4896-af58-b1d9299ff932 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:54.324421 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-20092fb5-7eee-4896-af58-b1d9299ff932 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.152026 Jun 26 03:06:54.324978 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 183/373] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:54 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:06:55.340459 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-84fb17ba-3512-447e-b8ec-7002d885d84c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:55.341068 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-84fb17ba-3512-447e-b8ec-7002d885d84c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:55.347513 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-84fb17ba-3512-447e-b8ec-7002d885d84c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:55.347964 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-84fb17ba-3512-447e-b8ec-7002d885d84c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:55.348730 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-84fb17ba-3512-447e-b8ec-7002d885d84c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:55.349162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-84fb17ba-3512-447e-b8ec-7002d885d84c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:55.492129 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-84fb17ba-3512-447e-b8ec-7002d885d84c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:55.501135 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-84fb17ba-3512-447e-b8ec-7002d885d84c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.164453 Jun 26 03:06:55.501699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 191/374] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:55 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:56.518382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-bb042cd5-c95e-4ddf-a156-3dfb6d792528 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:56.519154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-bb042cd5-c95e-4ddf-a156-3dfb6d792528 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:56.524990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bb042cd5-c95e-4ddf-a156-3dfb6d792528 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:56.525647 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bb042cd5-c95e-4ddf-a156-3dfb6d792528 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:56.526427 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bb042cd5-c95e-4ddf-a156-3dfb6d792528 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:56.527017 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bb042cd5-c95e-4ddf-a156-3dfb6d792528 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:56.658227 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-bb042cd5-c95e-4ddf-a156-3dfb6d792528 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:56.665933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-bb042cd5-c95e-4ddf-a156-3dfb6d792528 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.151796 Jun 26 03:06:56.677559 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 184/375] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:56 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:57.684744 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d2a705ba-cfcc-452b-a98b-b843111673fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:57.685350 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d2a705ba-cfcc-452b-a98b-b843111673fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:57.692176 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d2a705ba-cfcc-452b-a98b-b843111673fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:57.692630 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d2a705ba-cfcc-452b-a98b-b843111673fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:57.693409 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d2a705ba-cfcc-452b-a98b-b843111673fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:57.693852 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d2a705ba-cfcc-452b-a98b-b843111673fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:57.830411 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d2a705ba-cfcc-452b-a98b-b843111673fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:57.840138 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d2a705ba-cfcc-452b-a98b-b843111673fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.159619 Jun 26 03:06:57.840785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 192/376] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:57 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:06:58.858132 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9e0d6033-7658-4bb1-af1c-1c0077633a66 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:06:58.858888 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9e0d6033-7658-4bb1-af1c-1c0077633a66 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:06:58.865402 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9e0d6033-7658-4bb1-af1c-1c0077633a66 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:58.866360 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9e0d6033-7658-4bb1-af1c-1c0077633a66 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:58.867815 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9e0d6033-7658-4bb1-af1c-1c0077633a66 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:06:58.868699 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9e0d6033-7658-4bb1-af1c-1c0077633a66 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:06:59.003720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9e0d6033-7658-4bb1-af1c-1c0077633a66 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:06:59.011196 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9e0d6033-7658-4bb1-af1c-1c0077633a66 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.156884 Jun 26 03:06:59.011755 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 185/377] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:06:58 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:00.028791 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b37f5cf8-3c2a-4269-9a21-b18e975dc83c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:00.029554 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b37f5cf8-3c2a-4269-9a21-b18e975dc83c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:00.040121 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b37f5cf8-3c2a-4269-9a21-b18e975dc83c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:00.043607 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b37f5cf8-3c2a-4269-9a21-b18e975dc83c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:00.044488 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b37f5cf8-3c2a-4269-9a21-b18e975dc83c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:00.045062 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b37f5cf8-3c2a-4269-9a21-b18e975dc83c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:00.195753 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b37f5cf8-3c2a-4269-9a21-b18e975dc83c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:00.204060 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b37f5cf8-3c2a-4269-9a21-b18e975dc83c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.179289 Jun 26 03:07:00.213158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 193/378] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:00 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:01.221909 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-874f7d8a-e51d-4418-a2a0-adc3015daf35 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:01.222772 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-874f7d8a-e51d-4418-a2a0-adc3015daf35 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:01.232489 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-874f7d8a-e51d-4418-a2a0-adc3015daf35 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:01.232938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-874f7d8a-e51d-4418-a2a0-adc3015daf35 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:01.233736 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-874f7d8a-e51d-4418-a2a0-adc3015daf35 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:01.234199 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-874f7d8a-e51d-4418-a2a0-adc3015daf35 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:01.421754 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-874f7d8a-e51d-4418-a2a0-adc3015daf35 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:01.434433 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-874f7d8a-e51d-4418-a2a0-adc3015daf35 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.217221 Jun 26 03:07:01.439938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 186/379] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:01 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:02.466824 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c5311565-176b-4d59-a603-9700b64bb0fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:02.468649 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c5311565-176b-4d59-a603-9700b64bb0fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:02.480333 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c5311565-176b-4d59-a603-9700b64bb0fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:02.481531 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c5311565-176b-4d59-a603-9700b64bb0fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:02.483028 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c5311565-176b-4d59-a603-9700b64bb0fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:02.484527 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c5311565-176b-4d59-a603-9700b64bb0fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:02.644303 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c5311565-176b-4d59-a603-9700b64bb0fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:02.654562 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c5311565-176b-4d59-a603-9700b64bb0fc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.194207 Jun 26 03:07:02.664157 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 194/380] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:02 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:03.671487 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5ab87c8a-8328-46ec-a711-ff2ea3c8a999 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:03.672886 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5ab87c8a-8328-46ec-a711-ff2ea3c8a999 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:03.680005 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5ab87c8a-8328-46ec-a711-ff2ea3c8a999 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:03.680737 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5ab87c8a-8328-46ec-a711-ff2ea3c8a999 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:03.681754 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5ab87c8a-8328-46ec-a711-ff2ea3c8a999 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:03.682274 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5ab87c8a-8328-46ec-a711-ff2ea3c8a999 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:03.825234 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5ab87c8a-8328-46ec-a711-ff2ea3c8a999 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:03.838541 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5ab87c8a-8328-46ec-a711-ff2ea3c8a999 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.171291 Jun 26 03:07:03.839533 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 187/381] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:03 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:04.857095 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ca8c63e2-5166-42b7-ad56-990fe9dc1400 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:04.858305 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ca8c63e2-5166-42b7-ad56-990fe9dc1400 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:04.862070 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:04.865821 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ca8c63e2-5166-42b7-ad56-990fe9dc1400 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:04.866486 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ca8c63e2-5166-42b7-ad56-990fe9dc1400 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:04.867460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ca8c63e2-5166-42b7-ad56-990fe9dc1400 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:04.867900 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ca8c63e2-5166-42b7-ad56-990fe9dc1400 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:05.034226 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ca8c63e2-5166-42b7-ad56-990fe9dc1400 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:05.046928 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ca8c63e2-5166-42b7-ad56-990fe9dc1400 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.194111 Jun 26 03:07:05.049069 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 195/382] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:04 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:06.068848 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e6e4d307-61ce-4be3-a115-252f0c88051a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:06.070667 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e6e4d307-61ce-4be3-a115-252f0c88051a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:06.080850 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e6e4d307-61ce-4be3-a115-252f0c88051a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:06.082794 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e6e4d307-61ce-4be3-a115-252f0c88051a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:06.084330 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e6e4d307-61ce-4be3-a115-252f0c88051a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:06.085083 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e6e4d307-61ce-4be3-a115-252f0c88051a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:06.266505 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e6e4d307-61ce-4be3-a115-252f0c88051a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:06.279366 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e6e4d307-61ce-4be3-a115-252f0c88051a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.217578 Jun 26 03:07:06.281658 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 188/383] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:06 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:07.297581 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f96f79c2-34c3-4277-998e-6063735be1ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:07.298957 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f96f79c2-34c3-4277-998e-6063735be1ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:07.312635 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f96f79c2-34c3-4277-998e-6063735be1ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:07.313320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f96f79c2-34c3-4277-998e-6063735be1ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:07.314334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f96f79c2-34c3-4277-998e-6063735be1ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:07.314786 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f96f79c2-34c3-4277-998e-6063735be1ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:07.462008 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f96f79c2-34c3-4277-998e-6063735be1ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:07.470657 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f96f79c2-34c3-4277-998e-6063735be1ac tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.177228 Jun 26 03:07:07.471821 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 196/384] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:07 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:08.489463 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ea2611fb-a505-4fb0-9963-f49515ba82fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:08.490404 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ea2611fb-a505-4fb0-9963-f49515ba82fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:08.497010 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ea2611fb-a505-4fb0-9963-f49515ba82fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:08.497551 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ea2611fb-a505-4fb0-9963-f49515ba82fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:08.498439 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ea2611fb-a505-4fb0-9963-f49515ba82fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:08.499725 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ea2611fb-a505-4fb0-9963-f49515ba82fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:08.635127 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ea2611fb-a505-4fb0-9963-f49515ba82fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:08.644994 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ea2611fb-a505-4fb0-9963-f49515ba82fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.159313 Jun 26 03:07:08.655876 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 189/385] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:08 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:09.662179 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-7350429f-eb58-4247-80b2-b00cf2ba8e96 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:09.662746 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-7350429f-eb58-4247-80b2-b00cf2ba8e96 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:09.669279 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7350429f-eb58-4247-80b2-b00cf2ba8e96 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:09.669742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7350429f-eb58-4247-80b2-b00cf2ba8e96 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:09.671184 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7350429f-eb58-4247-80b2-b00cf2ba8e96 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:09.671641 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7350429f-eb58-4247-80b2-b00cf2ba8e96 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:09.812274 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-7350429f-eb58-4247-80b2-b00cf2ba8e96 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:09.820351 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-7350429f-eb58-4247-80b2-b00cf2ba8e96 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.162149 Jun 26 03:07:09.820919 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 197/386] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:09 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:10.837719 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-10c6f2d8-8ea2-49fd-bf37-1c8a7b795a92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:10.838363 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-10c6f2d8-8ea2-49fd-bf37-1c8a7b795a92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:10.845695 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10c6f2d8-8ea2-49fd-bf37-1c8a7b795a92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:10.846181 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10c6f2d8-8ea2-49fd-bf37-1c8a7b795a92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:10.846962 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10c6f2d8-8ea2-49fd-bf37-1c8a7b795a92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:10.847405 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10c6f2d8-8ea2-49fd-bf37-1c8a7b795a92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:11.009107 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-10c6f2d8-8ea2-49fd-bf37-1c8a7b795a92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:11.016607 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-10c6f2d8-8ea2-49fd-bf37-1c8a7b795a92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.183014 Jun 26 03:07:11.017400 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 190/387] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:10 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:12.033644 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1e0bfee5-f7df-4c3b-b92d-eb569d457346 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:12.034286 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1e0bfee5-f7df-4c3b-b92d-eb569d457346 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:12.041400 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1e0bfee5-f7df-4c3b-b92d-eb569d457346 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:12.042208 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1e0bfee5-f7df-4c3b-b92d-eb569d457346 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:12.043834 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1e0bfee5-f7df-4c3b-b92d-eb569d457346 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:12.044600 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1e0bfee5-f7df-4c3b-b92d-eb569d457346 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:12.242981 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1e0bfee5-f7df-4c3b-b92d-eb569d457346 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:12.251430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1e0bfee5-f7df-4c3b-b92d-eb569d457346 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.221696 Jun 26 03:07:12.260833 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 198/388] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:12 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:13.268389 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f51927fb-b170-4823-8989-0d4a6014e1b7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:13.268991 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f51927fb-b170-4823-8989-0d4a6014e1b7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:13.284130 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f51927fb-b170-4823-8989-0d4a6014e1b7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:13.284583 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f51927fb-b170-4823-8989-0d4a6014e1b7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:13.285361 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f51927fb-b170-4823-8989-0d4a6014e1b7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:13.285798 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f51927fb-b170-4823-8989-0d4a6014e1b7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:13.566652 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f51927fb-b170-4823-8989-0d4a6014e1b7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:13.571129 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=100 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:13.580049 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f51927fb-b170-4823-8989-0d4a6014e1b7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.315330 Jun 26 03:07:13.581356 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 191/389] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:13 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:14.597243 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fec2d9ec-a887-4515-b591-f290931e5638 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:14.597855 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fec2d9ec-a887-4515-b591-f290931e5638 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:14.605151 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fec2d9ec-a887-4515-b591-f290931e5638 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:14.605616 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fec2d9ec-a887-4515-b591-f290931e5638 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:14.606442 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fec2d9ec-a887-4515-b591-f290931e5638 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:14.606890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fec2d9ec-a887-4515-b591-f290931e5638 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:14.753105 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fec2d9ec-a887-4515-b591-f290931e5638 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:14.761309 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fec2d9ec-a887-4515-b591-f290931e5638 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.168477 Jun 26 03:07:14.761943 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 199/390] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:14 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:15.779613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e50e77a4-77f7-494a-bff0-4bea363ddcfc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:15.780233 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e50e77a4-77f7-494a-bff0-4bea363ddcfc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:15.787235 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e50e77a4-77f7-494a-bff0-4bea363ddcfc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:15.787828 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e50e77a4-77f7-494a-bff0-4bea363ddcfc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:15.788807 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e50e77a4-77f7-494a-bff0-4bea363ddcfc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:15.789440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e50e77a4-77f7-494a-bff0-4bea363ddcfc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:16.064638 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e50e77a4-77f7-494a-bff0-4bea363ddcfc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:16.073851 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e50e77a4-77f7-494a-bff0-4bea363ddcfc tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1502 microversion: 2.1 time: 0.298362 Jun 26 03:07:16.074109 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 192/391] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:15 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1502 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:16.091812 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-7e88041f-92db-47af-b2a5-8ddbe835a8c2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2dad194-ce86-4afb-8607-a627b42330ad"}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:16.093580 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-7e88041f-92db-47af-b2a5-8ddbe835a8c2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:16.100887 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7e88041f-92db-47af-b2a5-8ddbe835a8c2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:16.101768 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7e88041f-92db-47af-b2a5-8ddbe835a8c2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:16.102234 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7e88041f-92db-47af-b2a5-8ddbe835a8c2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:16.102682 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7e88041f-92db-47af-b2a5-8ddbe835a8c2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:16.127210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-7e88041f-92db-47af-b2a5-8ddbe835a8c2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] HTTP exception thrown: Cannot 'attach_volume' instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf while it is in vm_state rescued Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-7e88041f-92db-47af-b2a5-8ddbe835a8c2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Request method failure captured: Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: POST /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf/os-volume_attachments HTTP/1.1 Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 74 Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zSuaVI5xGBKyt-ni0Q6VRanK0970QIQANht8SFYhxu6bIsUY6Gf98v9efGuB4_m7etgpFVQIiRT1YM4ymg0wjUqIXRNUniyVH783p5_8w9vV_EaiXGuCuSGWlSvG2V2PJ3CS0fR7hmPpRLXSI43DBw5gTc8Hdnlc6J3Fo1C2_HlFs Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: aa1dff9e9be549308ec0ad3a13810062 Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:07:16.128669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:07:16.129915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa1dff9e9be549308ec0ad3a13810062"}]}] Jun 26 03:07:16.129915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:07:16.129915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: aa1dff9e9be549308ec0ad3a13810062 Jun 26 03:07:16.129915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:07:16.129915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-ServerRescueNegativeTestJSON-1294839629-project Jun 26 03:07:16.129915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:07:16.129915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:07:16.129915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: a1313e0937b842059f1e01480c98351c Jun 26 03:07:16.129915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1294839629-project Jun 26 03:07:16.129915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Jun 26 03:07:16.129915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {"volumeAttachment": {"volumeId": "f2dad194-ce86-4afb-8607-a627b42330ad"}} Jun 26 03:07:16.129915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Cannot 'attach_volume' instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf while it is in vm_state rescued Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'server_id': 'cddc852a-2aa2-4a44-ad1a-e9e930e3bddf', 'body': {'volumeAttachment': {'volumeId': 'f2dad194-ce86-4afb-8607-a627b42330ad'}}} Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:07:16.130831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf while it is in vm_state rescued Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:07:16.132035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:07:16.133318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:07:16.133318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:07:16.133318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf while it is in vm_state rescued Jun 26 03:07:16.133318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:07:16.133318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-7e88041f-92db-47af-b2a5-8ddbe835a8c2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Returning 409 to user: Cannot 'attach_volume' instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf while it is in vm_state rescued {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:07:16.133318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-7e88041f-92db-47af-b2a5-8ddbe835a8c2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "POST /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042857 Jun 26 03:07:16.134478 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 200/392] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:07:16 2022] POST /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 26 03:07:16.139361 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e29183fb-e509-4706-98d2-a5776743fa89 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:16.139928 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e29183fb-e509-4706-98d2-a5776743fa89 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:16.145986 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e29183fb-e509-4706-98d2-a5776743fa89 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:16.146487 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e29183fb-e509-4706-98d2-a5776743fa89 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:16.147251 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e29183fb-e509-4706-98d2-a5776743fa89 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:16.147857 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e29183fb-e509-4706-98d2-a5776743fa89 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:16.227977 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e29183fb-e509-4706-98d2-a5776743fa89 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "POST /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf/action" status: 202 len: 0 microversion: 2.1 time: 0.092287 Jun 26 03:07:16.228996 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 193/393] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:07:16 2022] POST /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:07:16.238665 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-afb5bb85-33e4-461e-9ecb-89d3032d9ffa tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:16.241915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-afb5bb85-33e4-461e-9ecb-89d3032d9ffa tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:16.256150 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-afb5bb85-33e4-461e-9ecb-89d3032d9ffa tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:16.256784 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-afb5bb85-33e4-461e-9ecb-89d3032d9ffa tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:16.258273 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-afb5bb85-33e4-461e-9ecb-89d3032d9ffa tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:16.258787 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-afb5bb85-33e4-461e-9ecb-89d3032d9ffa tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:16.596524 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-afb5bb85-33e4-461e-9ecb-89d3032d9ffa tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:16.604046 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-afb5bb85-33e4-461e-9ecb-89d3032d9ffa tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1510 microversion: 2.1 time: 0.370904 Jun 26 03:07:16.604734 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 201/394] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:16 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:17.625715 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-79e02bc6-cf67-4325-a6f9-5ef1462229a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:17.627031 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-79e02bc6-cf67-4325-a6f9-5ef1462229a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:17.634905 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-79e02bc6-cf67-4325-a6f9-5ef1462229a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:17.635364 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-79e02bc6-cf67-4325-a6f9-5ef1462229a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:17.636152 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-79e02bc6-cf67-4325-a6f9-5ef1462229a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:17.636598 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-79e02bc6-cf67-4325-a6f9-5ef1462229a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:17.792991 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-79e02bc6-cf67-4325-a6f9-5ef1462229a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:17.801135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-79e02bc6-cf67-4325-a6f9-5ef1462229a5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1510 microversion: 2.1 time: 0.180088 Jun 26 03:07:17.807717 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 194/395] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:17 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:18.819254 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-74db5e76-1520-4111-8281-c8e3e2f215bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:18.819888 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-74db5e76-1520-4111-8281-c8e3e2f215bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:18.826664 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-74db5e76-1520-4111-8281-c8e3e2f215bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:18.827121 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-74db5e76-1520-4111-8281-c8e3e2f215bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:18.827968 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-74db5e76-1520-4111-8281-c8e3e2f215bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:18.828406 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-74db5e76-1520-4111-8281-c8e3e2f215bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:19.062794 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-74db5e76-1520-4111-8281-c8e3e2f215bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:19.066261 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:19.071200 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-74db5e76-1520-4111-8281-c8e3e2f215bf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1510 microversion: 2.1 time: 0.255883 Jun 26 03:07:19.071981 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 202/396] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:18 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:20.087366 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8ae83930-92d0-46ab-803e-347d5c7a524b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:20.087978 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8ae83930-92d0-46ab-803e-347d5c7a524b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:20.094655 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8ae83930-92d0-46ab-803e-347d5c7a524b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:20.095135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8ae83930-92d0-46ab-803e-347d5c7a524b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:20.095928 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8ae83930-92d0-46ab-803e-347d5c7a524b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:20.096369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8ae83930-92d0-46ab-803e-347d5c7a524b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:20.225097 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8ae83930-92d0-46ab-803e-347d5c7a524b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:20.232801 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8ae83930-92d0-46ab-803e-347d5c7a524b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1516 microversion: 2.1 time: 0.149319 Jun 26 03:07:20.233367 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 195/397] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:20 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:21.031621 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-93793488", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "networks": [{"uuid": "23f3dc3b-096d-4bd7-ac08-420e217fa87e"}]}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:21.083258 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] validate_networks() for [('23f3dc3b-096d-4bd7-ac08-420e217fa87e', None, None, None, None, None)] {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:07:21.417641 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:07:21.418091 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:07:21.418570 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:07:21.418975 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:07:21.420069 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:07:21.429488 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:21.430014 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:21.430961 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:21.431462 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:21.447831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Getting quotas for project f93abb7628324906baa8d45ce8d1a153. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:07:21.451962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Getting quotas for user 497fd3327d1441c8b3933bda95f673af and project f93abb7628324906baa8d45ce8d1a153. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:07:21.462520 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:07:21.464710 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:07:21.510563 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-86b45c46-4687-4733-91f5-fe24346055ef tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483245 Jun 26 03:07:21.511148 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 203/398] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:07:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:07:21.520750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d049730d-10a3-42af-b8e1-c9de4c590905 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:21.522199 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d049730d-10a3-42af-b8e1-c9de4c590905 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:21.562470 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-792f7e4b-062f-4311-bd49-b045d014afdf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Action: 'create', calling method: .version_select at 0x7f582c0894c0>, body: {"keypair": {"name": "tempest-keypair-1422837008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInpjWduLllR0GY6MHbQ116CYRbYK8xq6KiLwNCt2H2MZ6Xh5tEn8RIGgvSFvnT57lQetz7dvf1UhIYDiJITzXkqX2A6lkAwIdZs/dRIfh1Snkw7R+qTj//mvgxWq98z1Q=="}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:21.578116 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-792f7e4b-062f-4311-bd49-b045d014afdf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Getting quotas for project aa1dff9e9be549308ec0ad3a13810062. Resources: {'key_pairs'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:07:21.581811 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d049730d-10a3-42af-b8e1-c9de4c590905 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:21.582718 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-792f7e4b-062f-4311-bd49-b045d014afdf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Getting quotas for user a1313e0937b842059f1e01480c98351c and project aa1dff9e9be549308ec0ad3a13810062. Resources: {'key_pairs'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:07:21.589881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d049730d-10a3-42af-b8e1-c9de4c590905 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1217 microversion: 2.1 time: 0.072916 Jun 26 03:07:21.598890 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 196/399] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:21 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:21.607655 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-792f7e4b-062f-4311-bd49-b045d014afdf tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050957 Jun 26 03:07:21.608246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 204/400] 10.222.0.13 () {60 vars in 1158 bytes} [Sun Jun 26 03:07:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:07:22.607814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d1c4f605-ab81-45ad-a3c2-ad48a81248c3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:22.610582 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d1c4f605-ab81-45ad-a3c2-ad48a81248c3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:22.618475 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d1c4f605-ab81-45ad-a3c2-ad48a81248c3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:22.620325 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d1c4f605-ab81-45ad-a3c2-ad48a81248c3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:22.621508 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d1c4f605-ab81-45ad-a3c2-ad48a81248c3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:22.624954 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d1c4f605-ab81-45ad-a3c2-ad48a81248c3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:22.705007 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d1c4f605-ab81-45ad-a3c2-ad48a81248c3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:22.713250 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d1c4f605-ab81-45ad-a3c2-ad48a81248c3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1287 microversion: 2.1 time: 0.109412 Jun 26 03:07:22.714268 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 197/401] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:22 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:22.919439 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-710556382", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d1cf2ab-1c05-4bc5-9daa-428f3ef27012"}], "security_groups": [{"name": "tempest-securitygroup--1348045660"}], "key_name": "tempest-keypair-1422837008", "user_data": "}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:23.060619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] validate_networks() for [('4d1cf2ab-1c05-4bc5-9daa-428f3ef27012', None, None, None, None, None)] {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:07:23.648464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:07:23.648919 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:07:23.649384 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:07:23.649793 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:07:23.650316 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:07:23.659253 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:23.659796 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:23.660596 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:23.661037 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:23.679299 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Getting quotas for project aa1dff9e9be549308ec0ad3a13810062. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:07:23.683069 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Getting quotas for user a1313e0937b842059f1e01480c98351c and project aa1dff9e9be549308ec0ad3a13810062. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:07:23.694289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:07:23.696470 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:07:23.732365 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c563b1a9-7693-434d-a17b-f861decb9db5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:23.733018 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c563b1a9-7693-434d-a17b-f861decb9db5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:23.739991 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c563b1a9-7693-434d-a17b-f861decb9db5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:23.740483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c563b1a9-7693-434d-a17b-f861decb9db5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:23.741296 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c563b1a9-7693-434d-a17b-f861decb9db5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:23.741981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c563b1a9-7693-434d-a17b-f861decb9db5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:23.748899 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-57fd7dbc-f029-4742-8e9e-1b934b857190 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.834085 Jun 26 03:07:23.756308 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 205/402] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:07:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:07:23.765700 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c6b2fc6f-78ee-4d18-9852-b8fd5c0d9258 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:23.766892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c6b2fc6f-78ee-4d18-9852-b8fd5c0d9258 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:24.094690 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c6b2fc6f-78ee-4d18-9852-b8fd5c0d9258 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:24.105224 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c6b2fc6f-78ee-4d18-9852-b8fd5c0d9258 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1245 microversion: 2.1 time: 0.347563 Jun 26 03:07:24.115193 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 206/403] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:23 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1245 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:07:24.183477 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c563b1a9-7693-434d-a17b-f861decb9db5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:24.193118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c563b1a9-7693-434d-a17b-f861decb9db5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1317 microversion: 2.1 time: 0.464732 Jun 26 03:07:24.193710 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 198/404] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:23 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:07:24.508299 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-73e55dd1-251a-429b-b156-0d78f1c38fd3 req-92605645-0604-422d-bc92-ba3bbadfa683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3029b3b4-985d-4a44-8afd-ec1e400fff6c", "tag": "769a529d-21f4-483c-a2a1-bd0854c06dc4"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:24.517394 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-73e55dd1-251a-429b-b156-0d78f1c38fd3 req-92605645-0604-422d-bc92-ba3bbadfa683 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:24.517928 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-73e55dd1-251a-429b-b156-0d78f1c38fd3 req-92605645-0604-422d-bc92-ba3bbadfa683 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:24.528856 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-73e55dd1-251a-429b-b156-0d78f1c38fd3 req-92605645-0604-422d-bc92-ba3bbadfa683 service nova] Creating event network-changed:769a529d-21f4-483c-a2a1-bd0854c06dc4 for instance 3029b3b4-985d-4a44-8afd-ec1e400fff6c on hv-cinder-84684 Jun 26 03:07:24.533745 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-73e55dd1-251a-429b-b156-0d78f1c38fd3 req-92605645-0604-422d-bc92-ba3bbadfa683 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029045 Jun 26 03:07:24.534350 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 207/405] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:07:25.122343 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b9c2ac81-562d-4cb6-b2e5-91576b20ab48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:25.122982 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b9c2ac81-562d-4cb6-b2e5-91576b20ab48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:25.124933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=34 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:25.130575 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b9c2ac81-562d-4cb6-b2e5-91576b20ab48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:25.131154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b9c2ac81-562d-4cb6-b2e5-91576b20ab48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:25.131952 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b9c2ac81-562d-4cb6-b2e5-91576b20ab48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:25.132370 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b9c2ac81-562d-4cb6-b2e5-91576b20ab48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:25.212934 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-512d5c6d-efb8-4db3-8aac-5fc1625cfe4c tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:25.213634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-512d5c6d-efb8-4db3-8aac-5fc1625cfe4c tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:25.220824 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-512d5c6d-efb8-4db3-8aac-5fc1625cfe4c tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:25.221269 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-512d5c6d-efb8-4db3-8aac-5fc1625cfe4c tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:25.222036 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-512d5c6d-efb8-4db3-8aac-5fc1625cfe4c tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:25.222489 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-512d5c6d-efb8-4db3-8aac-5fc1625cfe4c tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:25.237957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b9c2ac81-562d-4cb6-b2e5-91576b20ab48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:25.246007 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b9c2ac81-562d-4cb6-b2e5-91576b20ab48 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1303 microversion: 2.1 time: 0.128423 Jun 26 03:07:25.246888 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 199/406] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:25 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:25.540083 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-512d5c6d-efb8-4db3-8aac-5fc1625cfe4c tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:25.547562 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-512d5c6d-efb8-4db3-8aac-5fc1625cfe4c tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1317 microversion: 2.1 time: 0.339233 Jun 26 03:07:25.548987 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 208/407] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:25 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:07:26.263557 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c46d101a-06a9-4a05-9462-82f2332af069 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:26.264163 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c46d101a-06a9-4a05-9462-82f2332af069 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:26.270578 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c46d101a-06a9-4a05-9462-82f2332af069 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:26.271034 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c46d101a-06a9-4a05-9462-82f2332af069 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:26.271791 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c46d101a-06a9-4a05-9462-82f2332af069 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:26.272226 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c46d101a-06a9-4a05-9462-82f2332af069 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:26.396514 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c46d101a-06a9-4a05-9462-82f2332af069 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:26.404548 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c46d101a-06a9-4a05-9462-82f2332af069 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1371 microversion: 2.1 time: 0.144857 Jun 26 03:07:26.405150 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 200/408] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:26 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:26.565090 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9171fae5-6c79-4f12-901f-675eb7b1d1e8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:26.565640 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9171fae5-6c79-4f12-901f-675eb7b1d1e8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:26.572129 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9171fae5-6c79-4f12-901f-675eb7b1d1e8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:26.572595 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9171fae5-6c79-4f12-901f-675eb7b1d1e8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:26.573359 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9171fae5-6c79-4f12-901f-675eb7b1d1e8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:26.573801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9171fae5-6c79-4f12-901f-675eb7b1d1e8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:26.699210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9171fae5-6c79-4f12-901f-675eb7b1d1e8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:26.707089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9171fae5-6c79-4f12-901f-675eb7b1d1e8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1317 microversion: 2.1 time: 0.146422 Jun 26 03:07:26.707641 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 209/409] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:26 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:27.422295 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c84f6923-1af1-4405-95aa-a6e418a6b520 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:27.422904 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c84f6923-1af1-4405-95aa-a6e418a6b520 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:27.428909 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c84f6923-1af1-4405-95aa-a6e418a6b520 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:27.429372 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c84f6923-1af1-4405-95aa-a6e418a6b520 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:27.430162 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c84f6923-1af1-4405-95aa-a6e418a6b520 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:27.430610 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c84f6923-1af1-4405-95aa-a6e418a6b520 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:27.558584 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c84f6923-1af1-4405-95aa-a6e418a6b520 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:27.565937 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c84f6923-1af1-4405-95aa-a6e418a6b520 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1371 microversion: 2.1 time: 0.148169 Jun 26 03:07:27.566527 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 201/410] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:27 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:27.724682 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-072301f5-36a3-4df4-b20b-8ca16c6518b3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:27.725232 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-072301f5-36a3-4df4-b20b-8ca16c6518b3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:27.731204 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-072301f5-36a3-4df4-b20b-8ca16c6518b3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:27.731658 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-072301f5-36a3-4df4-b20b-8ca16c6518b3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:27.732421 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-072301f5-36a3-4df4-b20b-8ca16c6518b3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:27.732864 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-072301f5-36a3-4df4-b20b-8ca16c6518b3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:27.860028 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-072301f5-36a3-4df4-b20b-8ca16c6518b3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:27.867484 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-072301f5-36a3-4df4-b20b-8ca16c6518b3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1317 microversion: 2.1 time: 0.146943 Jun 26 03:07:27.868049 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 210/411] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:27 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:28.582678 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-75e77216-48ae-4737-b808-6b6a98085104 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:28.583383 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-75e77216-48ae-4737-b808-6b6a98085104 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:28.589725 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-75e77216-48ae-4737-b808-6b6a98085104 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:28.590213 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-75e77216-48ae-4737-b808-6b6a98085104 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:28.590975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-75e77216-48ae-4737-b808-6b6a98085104 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:28.591408 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-75e77216-48ae-4737-b808-6b6a98085104 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:28.777730 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-75e77216-48ae-4737-b808-6b6a98085104 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:28.785042 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-75e77216-48ae-4737-b808-6b6a98085104 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1371 microversion: 2.1 time: 0.206266 Jun 26 03:07:28.785607 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 202/412] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:28 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:28.885236 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-97cc34ab-aee2-4e51-adb6-cc0987315cf0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:28.886510 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-97cc34ab-aee2-4e51-adb6-cc0987315cf0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:28.892913 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-97cc34ab-aee2-4e51-adb6-cc0987315cf0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:28.893637 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-97cc34ab-aee2-4e51-adb6-cc0987315cf0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:28.894444 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-97cc34ab-aee2-4e51-adb6-cc0987315cf0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:28.895059 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-97cc34ab-aee2-4e51-adb6-cc0987315cf0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:29.091443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-97cc34ab-aee2-4e51-adb6-cc0987315cf0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:29.099502 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-97cc34ab-aee2-4e51-adb6-cc0987315cf0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1317 microversion: 2.1 time: 0.218456 Jun 26 03:07:29.099996 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 211/413] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:28 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:29.153502 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-27f732ee-7a55-45df-96b2-c1ca8a002145 req-ba8dae61-8c76-46bb-85f2-1e87470c6dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473e061c-b6d3-4dff-9171-45f7acfaffee", "tag": "9ffa489f-38cb-4f25-9eb2-e940343d2383"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:29.164225 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-27f732ee-7a55-45df-96b2-c1ca8a002145 req-ba8dae61-8c76-46bb-85f2-1e87470c6dfa service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:29.164782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-27f732ee-7a55-45df-96b2-c1ca8a002145 req-ba8dae61-8c76-46bb-85f2-1e87470c6dfa service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:29.178999 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-27f732ee-7a55-45df-96b2-c1ca8a002145 req-ba8dae61-8c76-46bb-85f2-1e87470c6dfa service nova] Creating event network-changed:9ffa489f-38cb-4f25-9eb2-e940343d2383 for instance 473e061c-b6d3-4dff-9171-45f7acfaffee on hv-cinder-84684 Jun 26 03:07:29.183956 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-27f732ee-7a55-45df-96b2-c1ca8a002145 req-ba8dae61-8c76-46bb-85f2-1e87470c6dfa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034867 Jun 26 03:07:29.184562 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 203/414] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:07:29.801310 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8b5dbb52-72cc-4c5d-baeb-3600f7092e49 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:29.801926 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8b5dbb52-72cc-4c5d-baeb-3600f7092e49 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:29.808509 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8b5dbb52-72cc-4c5d-baeb-3600f7092e49 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:29.808871 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8b5dbb52-72cc-4c5d-baeb-3600f7092e49 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:29.809639 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8b5dbb52-72cc-4c5d-baeb-3600f7092e49 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:29.810107 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8b5dbb52-72cc-4c5d-baeb-3600f7092e49 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:29.940059 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-8b5dbb52-72cc-4c5d-baeb-3600f7092e49 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:29.947411 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8b5dbb52-72cc-4c5d-baeb-3600f7092e49 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1371 microversion: 2.1 time: 0.150004 Jun 26 03:07:29.947970 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 212/415] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:29 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:30.117205 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6bb5b810-8636-4824-9af9-633adf299b8e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:30.117819 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-6bb5b810-8636-4824-9af9-633adf299b8e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:30.123979 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6bb5b810-8636-4824-9af9-633adf299b8e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:30.124436 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6bb5b810-8636-4824-9af9-633adf299b8e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:30.125185 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6bb5b810-8636-4824-9af9-633adf299b8e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:30.125616 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6bb5b810-8636-4824-9af9-633adf299b8e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:30.254571 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-6bb5b810-8636-4824-9af9-633adf299b8e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:30.261931 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6bb5b810-8636-4824-9af9-633adf299b8e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1317 microversion: 2.1 time: 0.148889 Jun 26 03:07:30.262538 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 204/416] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:30 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:30.964570 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-47c26847-1deb-421e-81d2-0181a5ee388d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:30.965194 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-47c26847-1deb-421e-81d2-0181a5ee388d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:30.971752 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47c26847-1deb-421e-81d2-0181a5ee388d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:30.972209 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47c26847-1deb-421e-81d2-0181a5ee388d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:30.972977 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47c26847-1deb-421e-81d2-0181a5ee388d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:30.973422 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47c26847-1deb-421e-81d2-0181a5ee388d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:31.100862 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-47c26847-1deb-421e-81d2-0181a5ee388d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:31.108207 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-47c26847-1deb-421e-81d2-0181a5ee388d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1371 microversion: 2.1 time: 0.147396 Jun 26 03:07:31.109317 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 213/417] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:30 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:31.279036 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-68790134-cebf-46cf-8d1b-3bfd757cd82e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:31.279696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-68790134-cebf-46cf-8d1b-3bfd757cd82e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:31.286209 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-68790134-cebf-46cf-8d1b-3bfd757cd82e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:31.286659 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-68790134-cebf-46cf-8d1b-3bfd757cd82e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:31.287466 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-68790134-cebf-46cf-8d1b-3bfd757cd82e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:31.287908 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-68790134-cebf-46cf-8d1b-3bfd757cd82e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:31.414257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-68790134-cebf-46cf-8d1b-3bfd757cd82e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:31.422118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-68790134-cebf-46cf-8d1b-3bfd757cd82e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1317 microversion: 2.1 time: 0.146895 Jun 26 03:07:31.422681 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 205/418] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:31 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:31.865143 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-81c92a74-8984-4cb2-9f5f-7734f7505c8f req-baa661dd-b31a-448f-9ea0-245df0c62774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3029b3b4-985d-4a44-8afd-ec1e400fff6c", "name": "network-vif-plugged", "status": "completed", "tag": "769a529d-21f4-483c-a2a1-bd0854c06dc4"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:31.873473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-81c92a74-8984-4cb2-9f5f-7734f7505c8f req-baa661dd-b31a-448f-9ea0-245df0c62774 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:31.874750 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-81c92a74-8984-4cb2-9f5f-7734f7505c8f req-baa661dd-b31a-448f-9ea0-245df0c62774 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:31.889273 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-81c92a74-8984-4cb2-9f5f-7734f7505c8f req-baa661dd-b31a-448f-9ea0-245df0c62774 service nova] Creating event network-vif-plugged:769a529d-21f4-483c-a2a1-bd0854c06dc4 for instance 3029b3b4-985d-4a44-8afd-ec1e400fff6c on hv-cinder-84684 Jun 26 03:07:31.895001 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-81c92a74-8984-4cb2-9f5f-7734f7505c8f req-baa661dd-b31a-448f-9ea0-245df0c62774 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033514 Jun 26 03:07:31.895660 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 214/419] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:07:32.125024 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-47d6078a-9d4c-4172-9bf1-3bc091c37d53 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:32.125628 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-47d6078a-9d4c-4172-9bf1-3bc091c37d53 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:32.127599 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=2 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:32.133256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-47d6078a-9d4c-4172-9bf1-3bc091c37d53 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:32.133702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-47d6078a-9d4c-4172-9bf1-3bc091c37d53 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:32.134502 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-47d6078a-9d4c-4172-9bf1-3bc091c37d53 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:32.134937 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-47d6078a-9d4c-4172-9bf1-3bc091c37d53 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:32.439757 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-dc123152-d807-463e-a714-d77dd0a3a385 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:32.440458 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-dc123152-d807-463e-a714-d77dd0a3a385 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:32.447085 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dc123152-d807-463e-a714-d77dd0a3a385 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:32.447541 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dc123152-d807-463e-a714-d77dd0a3a385 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:32.448316 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dc123152-d807-463e-a714-d77dd0a3a385 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:32.448762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dc123152-d807-463e-a714-d77dd0a3a385 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:32.545629 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-47d6078a-9d4c-4172-9bf1-3bc091c37d53 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:32.553066 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-47d6078a-9d4c-4172-9bf1-3bc091c37d53 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1371 microversion: 2.1 time: 0.431817 Jun 26 03:07:32.553634 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 206/420] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:32 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1371 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:32.740126 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-dc123152-d807-463e-a714-d77dd0a3a385 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:32.747713 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-dc123152-d807-463e-a714-d77dd0a3a385 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1317 microversion: 2.1 time: 0.312673 Jun 26 03:07:32.748287 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 215/421] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:32 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:07:33.570317 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f4b08785-9b32-4892-a6d2-69f36cff6e3f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:33.570874 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f4b08785-9b32-4892-a6d2-69f36cff6e3f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:33.576889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f4b08785-9b32-4892-a6d2-69f36cff6e3f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:33.577346 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f4b08785-9b32-4892-a6d2-69f36cff6e3f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:33.578138 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f4b08785-9b32-4892-a6d2-69f36cff6e3f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:33.578583 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f4b08785-9b32-4892-a6d2-69f36cff6e3f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:33.705174 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f4b08785-9b32-4892-a6d2-69f36cff6e3f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:33.712526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f4b08785-9b32-4892-a6d2-69f36cff6e3f tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1371 microversion: 2.1 time: 0.146180 Jun 26 03:07:33.713085 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 207/422] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:33 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:33.765127 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-82beedb2-6055-408c-8127-c67ebcc9c1d7 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:33.765752 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-82beedb2-6055-408c-8127-c67ebcc9c1d7 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:33.768159 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=4 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:33.773459 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-82beedb2-6055-408c-8127-c67ebcc9c1d7 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:33.773919 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-82beedb2-6055-408c-8127-c67ebcc9c1d7 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:33.774728 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-82beedb2-6055-408c-8127-c67ebcc9c1d7 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:33.775174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-82beedb2-6055-408c-8127-c67ebcc9c1d7 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:33.925273 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-82beedb2-6055-408c-8127-c67ebcc9c1d7 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:33.933518 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-82beedb2-6055-408c-8127-c67ebcc9c1d7 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1317 microversion: 2.1 time: 0.172715 Jun 26 03:07:33.934521 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 216/423] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:33 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:34.728817 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9d9c5d9e-1f8d-4c34-8a77-4d116610ecfb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:34.729436 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9d9c5d9e-1f8d-4c34-8a77-4d116610ecfb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:34.736039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9d9c5d9e-1f8d-4c34-8a77-4d116610ecfb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:34.736491 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9d9c5d9e-1f8d-4c34-8a77-4d116610ecfb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:34.737257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9d9c5d9e-1f8d-4c34-8a77-4d116610ecfb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:34.737702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9d9c5d9e-1f8d-4c34-8a77-4d116610ecfb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:34.865584 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9d9c5d9e-1f8d-4c34-8a77-4d116610ecfb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:34.872973 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9d9c5d9e-1f8d-4c34-8a77-4d116610ecfb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1371 microversion: 2.1 time: 0.148160 Jun 26 03:07:34.873561 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 208/424] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:34 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:34.950760 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9f02a210-a194-478b-acdf-b63ce1a790df tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:34.951770 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9f02a210-a194-478b-acdf-b63ce1a790df tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:34.953693 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=18 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:34.955110 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:34.961100 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9f02a210-a194-478b-acdf-b63ce1a790df tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:34.961550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9f02a210-a194-478b-acdf-b63ce1a790df tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:34.962353 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9f02a210-a194-478b-acdf-b63ce1a790df tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:34.962786 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9f02a210-a194-478b-acdf-b63ce1a790df tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:35.093729 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9f02a210-a194-478b-acdf-b63ce1a790df tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:35.101024 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9f02a210-a194-478b-acdf-b63ce1a790df tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1506 microversion: 2.1 time: 0.154556 Jun 26 03:07:35.101581 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 217/425] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:34 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:35.890257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c879ade9-f5cd-4955-998b-00aa53a6b0db tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:35.890868 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c879ade9-f5cd-4955-998b-00aa53a6b0db tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:35.896787 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c879ade9-f5cd-4955-998b-00aa53a6b0db tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:35.897233 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c879ade9-f5cd-4955-998b-00aa53a6b0db tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:35.897990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c879ade9-f5cd-4955-998b-00aa53a6b0db tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:35.898454 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c879ade9-f5cd-4955-998b-00aa53a6b0db tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:35.902381 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:36.040909 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c879ade9-f5cd-4955-998b-00aa53a6b0db tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:36.050079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c879ade9-f5cd-4955-998b-00aa53a6b0db tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1371 microversion: 2.1 time: 0.164093 Jun 26 03:07:36.050937 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 209/426] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:35 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:36.059902 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-1ed8ba16-70d9-41b6-a720-d05c05287c23 req-c5f5ad53-c083-4417-91c6-7874f5179e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473e061c-b6d3-4dff-9171-45f7acfaffee", "name": "network-vif-plugged", "status": "completed", "tag": "9ffa489f-38cb-4f25-9eb2-e940343d2383"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:36.071450 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-1ed8ba16-70d9-41b6-a720-d05c05287c23 req-c5f5ad53-c083-4417-91c6-7874f5179e46 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:36.072158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-1ed8ba16-70d9-41b6-a720-d05c05287c23 req-c5f5ad53-c083-4417-91c6-7874f5179e46 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:36.084612 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-1ed8ba16-70d9-41b6-a720-d05c05287c23 req-c5f5ad53-c083-4417-91c6-7874f5179e46 service nova] Creating event network-vif-plugged:9ffa489f-38cb-4f25-9eb2-e940343d2383 for instance 473e061c-b6d3-4dff-9171-45f7acfaffee on hv-cinder-84684 Jun 26 03:07:36.089519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-1ed8ba16-70d9-41b6-a720-d05c05287c23 req-c5f5ad53-c083-4417-91c6-7874f5179e46 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033391 Jun 26 03:07:36.090107 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 218/427] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:07:37.067518 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b24d3e63-f9a7-46ea-9e91-e39ed27401f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:37.068153 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b24d3e63-f9a7-46ea-9e91-e39ed27401f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:37.074240 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b24d3e63-f9a7-46ea-9e91-e39ed27401f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:37.074683 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b24d3e63-f9a7-46ea-9e91-e39ed27401f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:37.075480 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b24d3e63-f9a7-46ea-9e91-e39ed27401f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:37.076061 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b24d3e63-f9a7-46ea-9e91-e39ed27401f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:37.210547 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b24d3e63-f9a7-46ea-9e91-e39ed27401f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:37.217853 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b24d3e63-f9a7-46ea-9e91-e39ed27401f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1371 microversion: 2.1 time: 0.154217 Jun 26 03:07:37.218436 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 210/428] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:37 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:38.235390 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-33be8ce9-04da-4221-8ce7-e3e972eb0053 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:38.236193 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-33be8ce9-04da-4221-8ce7-e3e972eb0053 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:38.244261 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-33be8ce9-04da-4221-8ce7-e3e972eb0053 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:38.244714 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-33be8ce9-04da-4221-8ce7-e3e972eb0053 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:38.245716 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-33be8ce9-04da-4221-8ce7-e3e972eb0053 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:38.246189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-33be8ce9-04da-4221-8ce7-e3e972eb0053 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:38.379031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-33be8ce9-04da-4221-8ce7-e3e972eb0053 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:38.386428 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-33be8ce9-04da-4221-8ce7-e3e972eb0053 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1371 microversion: 2.1 time: 0.155327 Jun 26 03:07:38.386984 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 219/429] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:38 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:39.404150 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f1ace2a6-ac05-45b9-9295-be06d0f236eb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:39.404788 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f1ace2a6-ac05-45b9-9295-be06d0f236eb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:39.411793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f1ace2a6-ac05-45b9-9295-be06d0f236eb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:39.412232 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f1ace2a6-ac05-45b9-9295-be06d0f236eb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:39.413099 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f1ace2a6-ac05-45b9-9295-be06d0f236eb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:39.413573 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f1ace2a6-ac05-45b9-9295-be06d0f236eb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:39.547182 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f1ace2a6-ac05-45b9-9295-be06d0f236eb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:39.556004 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f1ace2a6-ac05-45b9-9295-be06d0f236eb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1565 microversion: 2.1 time: 0.155923 Jun 26 03:07:39.556587 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 211/430] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:39 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:39.573398 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0b63e521-6ebd-4a71-a05f-ceb6ba924458 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:39.574188 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0b63e521-6ebd-4a71-a05f-ceb6ba924458 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:39.580682 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0b63e521-6ebd-4a71-a05f-ceb6ba924458 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:39.581133 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0b63e521-6ebd-4a71-a05f-ceb6ba924458 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:39.581885 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0b63e521-6ebd-4a71-a05f-ceb6ba924458 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:39.582357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0b63e521-6ebd-4a71-a05f-ceb6ba924458 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:39.659392 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0b63e521-6ebd-4a71-a05f-ceb6ba924458 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089848 Jun 26 03:07:39.659977 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 220/431] 10.222.0.13 () {58 vars in 1274 bytes} [Sun Jun 26 03:07:39 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:07:40.498260 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ed1e5c51-00fc-4bee-a49e-00fa4b353784 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:40.498867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ed1e5c51-00fc-4bee-a49e-00fa4b353784 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:40.505973 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ed1e5c51-00fc-4bee-a49e-00fa4b353784 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:40.506460 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ed1e5c51-00fc-4bee-a49e-00fa4b353784 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:40.507246 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ed1e5c51-00fc-4bee-a49e-00fa4b353784 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:40.507694 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ed1e5c51-00fc-4bee-a49e-00fa4b353784 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:40.532862 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ed1e5c51-00fc-4bee-a49e-00fa4b353784 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/ips" status: 200 len: 146 microversion: 2.1 time: 0.038413 Jun 26 03:07:40.533452 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 212/432] 10.222.0.13 () {58 vars in 1247 bytes} [Sun Jun 26 03:07:40 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:07:41.000413 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-a30305fe-93f0-4b45-a5f6-614f07c7264d req-6af7c182-09db-4599-a63c-765348397641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473e061c-b6d3-4dff-9171-45f7acfaffee", "tag": "9ffa489f-38cb-4f25-9eb2-e940343d2383"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:41.008767 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-a30305fe-93f0-4b45-a5f6-614f07c7264d req-6af7c182-09db-4599-a63c-765348397641 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:41.009217 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-a30305fe-93f0-4b45-a5f6-614f07c7264d req-6af7c182-09db-4599-a63c-765348397641 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:41.020529 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-a30305fe-93f0-4b45-a5f6-614f07c7264d req-6af7c182-09db-4599-a63c-765348397641 service nova] Creating event network-changed:9ffa489f-38cb-4f25-9eb2-e940343d2383 for instance 473e061c-b6d3-4dff-9171-45f7acfaffee on hv-cinder-84684 Jun 26 03:07:41.025490 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-a30305fe-93f0-4b45-a5f6-614f07c7264d req-6af7c182-09db-4599-a63c-765348397641 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029311 Jun 26 03:07:41.026287 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 221/433] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:07:44.337187 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-54d53fff-9137-4b07-baf6-a042bb1c9b88 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ea326be-5b31-4d0c-8f81-5b5b807b7bf5"}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:44.338318 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-54d53fff-9137-4b07-baf6-a042bb1c9b88 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:44.344732 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-54d53fff-9137-4b07-baf6-a042bb1c9b88 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:44.345183 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-54d53fff-9137-4b07-baf6-a042bb1c9b88 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:44.346631 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-54d53fff-9137-4b07-baf6-a042bb1c9b88 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:44.347072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-54d53fff-9137-4b07-baf6-a042bb1c9b88 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:44.647457 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-54d53fff-9137-4b07-baf6-a042bb1c9b88 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "POST /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313884 Jun 26 03:07:44.648070 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 213/434] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:07:44 2022] POST /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:07:44.760943 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9a5706dc-c26c-4894-8d19-7a23f750eadb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:44.761523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9a5706dc-c26c-4894-8d19-7a23f750eadb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:44.770143 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9a5706dc-c26c-4894-8d19-7a23f750eadb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:44.770599 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9a5706dc-c26c-4894-8d19-7a23f750eadb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:44.771366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9a5706dc-c26c-4894-8d19-7a23f750eadb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:44.771802 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9a5706dc-c26c-4894-8d19-7a23f750eadb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:44.796567 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9a5706dc-c26c-4894-8d19-7a23f750eadb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab/ips" status: 200 len: 149 microversion: 2.1 time: 0.039618 Jun 26 03:07:44.797066 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 222/435] 10.222.0.13 () {58 vars in 1247 bytes} [Sun Jun 26 03:07:44 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:07:46.229140 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4ffa3aa6-79ba-4075-85bc-b926ad73672e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc863443-bb62-4d8c-af57-0571ba9c7534"}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:46.230325 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4ffa3aa6-79ba-4075-85bc-b926ad73672e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:46.237497 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4ffa3aa6-79ba-4075-85bc-b926ad73672e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:46.237932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4ffa3aa6-79ba-4075-85bc-b926ad73672e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:46.238721 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4ffa3aa6-79ba-4075-85bc-b926ad73672e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:46.239160 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4ffa3aa6-79ba-4075-85bc-b926ad73672e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:46.516099 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4ffa3aa6-79ba-4075-85bc-b926ad73672e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "POST /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291387 Jun 26 03:07:46.516929 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 214/436] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:07:46 2022] POST /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:07:47.297363 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8b57fad0-e78d-4084-970b-b21e0d1d22fc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:47.297941 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8b57fad0-e78d-4084-970b-b21e0d1d22fc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:47.304338 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8b57fad0-e78d-4084-970b-b21e0d1d22fc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:47.304782 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8b57fad0-e78d-4084-970b-b21e0d1d22fc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:47.305532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8b57fad0-e78d-4084-970b-b21e0d1d22fc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:47.305966 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8b57fad0-e78d-4084-970b-b21e0d1d22fc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:47.328936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8b57fad0-e78d-4084-970b-b21e0d1d22fc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/ips" status: 200 len: 152 microversion: 2.20 time: 0.035442 Jun 26 03:07:47.329503 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 223/437] 10.222.0.13 () {60 vars in 1288 bytes} [Sun Jun 26 03:07:47 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 03:07:50.251866 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-0694960d-e3e4-45e8-9b2e-8b7c4f4c39d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:50.253064 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-0694960d-e3e4-45e8-9b2e-8b7c4f4c39d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:50.259428 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0694960d-e3e4-45e8-9b2e-8b7c4f4c39d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:50.259875 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0694960d-e3e4-45e8-9b2e-8b7c4f4c39d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:50.260633 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0694960d-e3e4-45e8-9b2e-8b7c4f4c39d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:50.261067 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0694960d-e3e4-45e8-9b2e-8b7c4f4c39d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:50.282608 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-0694960d-e3e4-45e8-9b2e-8b7c4f4c39d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lazy-loading 'flavor' on Instance uuid 3b0d1d9b-d025-442c-a2f6-db22050d9059 {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:07:50.554944 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-0694960d-e3e4-45e8-9b2e-8b7c4f4c39d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "POST /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/action" status: 202 len: 0 microversion: 2.20 time: 0.307702 Jun 26 03:07:50.555555 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 215/438] 10.222.0.13 () {62 vars in 1318 bytes} [Sun Jun 26 03:07:50 2022] POST /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:07:50.563710 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-507ba6b0-6a12-4146-a80e-044ac2293f13 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:50.564323 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-507ba6b0-6a12-4146-a80e-044ac2293f13 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:50.570784 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-507ba6b0-6a12-4146-a80e-044ac2293f13 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:50.571231 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-507ba6b0-6a12-4146-a80e-044ac2293f13 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:50.572012 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-507ba6b0-6a12-4146-a80e-044ac2293f13 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:50.572461 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-507ba6b0-6a12-4146-a80e-044ac2293f13 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:50.703819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-507ba6b0-6a12-4146-a80e-044ac2293f13 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:50.711761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-507ba6b0-6a12-4146-a80e-044ac2293f13 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:50.713278 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-507ba6b0-6a12-4146-a80e-044ac2293f13 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:50.714468 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-507ba6b0-6a12-4146-a80e-044ac2293f13 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.154616 Jun 26 03:07:50.715026 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 224/439] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:07:50 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:07:51.734370 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-31383a49-bc71-44a7-add4-3590f3ef0b02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:51.735066 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-31383a49-bc71-44a7-add4-3590f3ef0b02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:51.741757 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31383a49-bc71-44a7-add4-3590f3ef0b02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:51.742255 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31383a49-bc71-44a7-add4-3590f3ef0b02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:51.743016 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31383a49-bc71-44a7-add4-3590f3ef0b02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:51.743459 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31383a49-bc71-44a7-add4-3590f3ef0b02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:51.876154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-31383a49-bc71-44a7-add4-3590f3ef0b02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:51.884960 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-31383a49-bc71-44a7-add4-3590f3ef0b02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:51.886481 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-31383a49-bc71-44a7-add4-3590f3ef0b02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:51.887628 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-31383a49-bc71-44a7-add4-3590f3ef0b02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.158002 Jun 26 03:07:51.888182 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 216/440] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:07:51 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:07:52.905551 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ddeae76e-8bc8-408f-be14-ddca35c4b271 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:52.906297 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ddeae76e-8bc8-408f-be14-ddca35c4b271 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:52.912796 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ddeae76e-8bc8-408f-be14-ddca35c4b271 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:52.913277 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ddeae76e-8bc8-408f-be14-ddca35c4b271 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:52.914001 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ddeae76e-8bc8-408f-be14-ddca35c4b271 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:52.914465 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ddeae76e-8bc8-408f-be14-ddca35c4b271 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:52.918536 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=91 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:53.040420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ddeae76e-8bc8-408f-be14-ddca35c4b271 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:53.048108 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ddeae76e-8bc8-408f-be14-ddca35c4b271 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:53.049593 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ddeae76e-8bc8-408f-be14-ddca35c4b271 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:53.050774 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ddeae76e-8bc8-408f-be14-ddca35c4b271 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.149085 Jun 26 03:07:53.051320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 225/441] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:07:52 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:07:53.184374 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-996b12af-8d0d-4baf-a33c-95eb135b4af1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:07:53.191431 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-996b12af-8d0d-4baf-a33c-95eb135b4af1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:53.191881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-996b12af-8d0d-4baf-a33c-95eb135b4af1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:53.251609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-996b12af-8d0d-4baf-a33c-95eb135b4af1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Going to try to stop instance {{(pid=117782) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 26 03:07:53.293197 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-996b12af-8d0d-4baf-a33c-95eb135b4af1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "POST /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.112468 Jun 26 03:07:53.293872 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 217/442] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:07:53 2022] POST /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:07:53.303396 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3a145313-df72-46da-94b3-6323561b7e8e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:53.304082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3a145313-df72-46da-94b3-6323561b7e8e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:53.310497 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a145313-df72-46da-94b3-6323561b7e8e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:53.311097 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a145313-df72-46da-94b3-6323561b7e8e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:53.312059 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a145313-df72-46da-94b3-6323561b7e8e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:53.312868 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a145313-df72-46da-94b3-6323561b7e8e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:53.443167 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3a145313-df72-46da-94b3-6323561b7e8e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:53.451811 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3a145313-df72-46da-94b3-6323561b7e8e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.152924 Jun 26 03:07:53.451811 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 226/443] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:53 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:54.073042 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3acea8af-ceff-48da-aa7f-bc71b3fd9896 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:54.073732 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3acea8af-ceff-48da-aa7f-bc71b3fd9896 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:54.079883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3acea8af-ceff-48da-aa7f-bc71b3fd9896 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:54.080815 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3acea8af-ceff-48da-aa7f-bc71b3fd9896 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:54.081560 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3acea8af-ceff-48da-aa7f-bc71b3fd9896 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:54.081993 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3acea8af-ceff-48da-aa7f-bc71b3fd9896 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:54.208321 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-3acea8af-ceff-48da-aa7f-bc71b3fd9896 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:54.216062 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-3acea8af-ceff-48da-aa7f-bc71b3fd9896 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:54.217557 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-3acea8af-ceff-48da-aa7f-bc71b3fd9896 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:54.218734 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3acea8af-ceff-48da-aa7f-bc71b3fd9896 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.149894 Jun 26 03:07:54.219281 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 218/444] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:07:54 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:07:54.467199 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a4f27e6d-9d59-4e4c-b27a-49cfb9ba2dec tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:54.467818 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a4f27e6d-9d59-4e4c-b27a-49cfb9ba2dec tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:54.474312 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a4f27e6d-9d59-4e4c-b27a-49cfb9ba2dec tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:54.474770 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a4f27e6d-9d59-4e4c-b27a-49cfb9ba2dec tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:54.475541 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a4f27e6d-9d59-4e4c-b27a-49cfb9ba2dec tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:54.475983 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a4f27e6d-9d59-4e4c-b27a-49cfb9ba2dec tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:54.605546 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a4f27e6d-9d59-4e4c-b27a-49cfb9ba2dec tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:54.613916 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a4f27e6d-9d59-4e4c-b27a-49cfb9ba2dec tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.150624 Jun 26 03:07:54.614503 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 227/445] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:54 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:55.237191 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fef38cc5-3139-4d63-865e-320ebddcd68c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:55.237791 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-fef38cc5-3139-4d63-865e-320ebddcd68c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:55.240296 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=40 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:55.245589 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fef38cc5-3139-4d63-865e-320ebddcd68c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:55.246033 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fef38cc5-3139-4d63-865e-320ebddcd68c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:55.246806 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fef38cc5-3139-4d63-865e-320ebddcd68c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:55.247239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fef38cc5-3139-4d63-865e-320ebddcd68c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:55.375514 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-fef38cc5-3139-4d63-865e-320ebddcd68c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:55.383687 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-fef38cc5-3139-4d63-865e-320ebddcd68c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:55.385206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-fef38cc5-3139-4d63-865e-320ebddcd68c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:55.386387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-fef38cc5-3139-4d63-865e-320ebddcd68c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.153603 Jun 26 03:07:55.386938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 219/446] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:07:55 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:07:55.630299 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e9361008-2223-40ff-be7a-55476c0049ca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:55.630910 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e9361008-2223-40ff-be7a-55476c0049ca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:55.637367 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e9361008-2223-40ff-be7a-55476c0049ca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:55.637813 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e9361008-2223-40ff-be7a-55476c0049ca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:55.638614 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e9361008-2223-40ff-be7a-55476c0049ca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:55.639051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e9361008-2223-40ff-be7a-55476c0049ca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:55.764656 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e9361008-2223-40ff-be7a-55476c0049ca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:55.773144 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e9361008-2223-40ff-be7a-55476c0049ca tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.146958 Jun 26 03:07:55.773704 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 228/447] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:55 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:56.405045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8042791f-404f-4a29-a3a7-6b1f992c19f6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:56.405649 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8042791f-404f-4a29-a3a7-6b1f992c19f6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:56.412741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8042791f-404f-4a29-a3a7-6b1f992c19f6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:56.413193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8042791f-404f-4a29-a3a7-6b1f992c19f6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:56.413952 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8042791f-404f-4a29-a3a7-6b1f992c19f6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:56.414416 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8042791f-404f-4a29-a3a7-6b1f992c19f6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:56.431693 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:56.547035 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8042791f-404f-4a29-a3a7-6b1f992c19f6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:56.555055 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8042791f-404f-4a29-a3a7-6b1f992c19f6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:56.556559 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8042791f-404f-4a29-a3a7-6b1f992c19f6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:56.557703 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8042791f-404f-4a29-a3a7-6b1f992c19f6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.156571 Jun 26 03:07:56.558291 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 220/448] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:07:56 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:07:56.790254 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2ebe1bea-86b8-4e32-a2bc-41ee4c71a863 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:56.790807 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2ebe1bea-86b8-4e32-a2bc-41ee4c71a863 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:56.797129 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2ebe1bea-86b8-4e32-a2bc-41ee4c71a863 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:56.797576 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2ebe1bea-86b8-4e32-a2bc-41ee4c71a863 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:56.798467 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2ebe1bea-86b8-4e32-a2bc-41ee4c71a863 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:56.799558 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2ebe1bea-86b8-4e32-a2bc-41ee4c71a863 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:56.928019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-2ebe1bea-86b8-4e32-a2bc-41ee4c71a863 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:56.935755 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2ebe1bea-86b8-4e32-a2bc-41ee4c71a863 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.149371 Jun 26 03:07:56.936314 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 229/449] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:56 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:57.576256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b9383d74-156e-43ad-a486-af77275fb8aa tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:57.576856 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b9383d74-156e-43ad-a486-af77275fb8aa tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:57.583255 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b9383d74-156e-43ad-a486-af77275fb8aa tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:57.583702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b9383d74-156e-43ad-a486-af77275fb8aa tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:57.584450 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b9383d74-156e-43ad-a486-af77275fb8aa tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:57.584881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b9383d74-156e-43ad-a486-af77275fb8aa tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:57.718832 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b9383d74-156e-43ad-a486-af77275fb8aa tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:57.727517 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b9383d74-156e-43ad-a486-af77275fb8aa tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:57.729023 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b9383d74-156e-43ad-a486-af77275fb8aa tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:57.730206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b9383d74-156e-43ad-a486-af77275fb8aa tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.157780 Jun 26 03:07:57.730749 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 221/450] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:07:57 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:07:57.952558 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d52b0427-fee8-4d62-bba0-02c7d441cca2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:57.953176 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d52b0427-fee8-4d62-bba0-02c7d441cca2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:57.959699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d52b0427-fee8-4d62-bba0-02c7d441cca2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:57.960158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d52b0427-fee8-4d62-bba0-02c7d441cca2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:57.960923 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d52b0427-fee8-4d62-bba0-02c7d441cca2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:57.961367 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d52b0427-fee8-4d62-bba0-02c7d441cca2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:58.088682 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d52b0427-fee8-4d62-bba0-02c7d441cca2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:58.096996 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d52b0427-fee8-4d62-bba0-02c7d441cca2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.148334 Jun 26 03:07:58.097559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 230/451] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:57 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:58.748353 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4da8a31d-4260-46b9-87f2-6fa263595b65 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:58.749005 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4da8a31d-4260-46b9-87f2-6fa263595b65 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:58.756099 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4da8a31d-4260-46b9-87f2-6fa263595b65 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:58.756546 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4da8a31d-4260-46b9-87f2-6fa263595b65 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:58.757293 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4da8a31d-4260-46b9-87f2-6fa263595b65 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:58.757720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4da8a31d-4260-46b9-87f2-6fa263595b65 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:58.883444 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4da8a31d-4260-46b9-87f2-6fa263595b65 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:58.891332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4da8a31d-4260-46b9-87f2-6fa263595b65 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:58.893481 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4da8a31d-4260-46b9-87f2-6fa263595b65 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:58.894687 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4da8a31d-4260-46b9-87f2-6fa263595b65 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.150150 Jun 26 03:07:58.895233 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 222/452] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:07:58 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:07:59.114130 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-33c1c33a-070d-40f6-9ead-959eab8309b2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:59.114663 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-33c1c33a-070d-40f6-9ead-959eab8309b2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:59.121017 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-33c1c33a-070d-40f6-9ead-959eab8309b2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:59.121474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-33c1c33a-070d-40f6-9ead-959eab8309b2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:59.122262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-33c1c33a-070d-40f6-9ead-959eab8309b2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:59.122705 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-33c1c33a-070d-40f6-9ead-959eab8309b2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:59.260787 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-33c1c33a-070d-40f6-9ead-959eab8309b2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:07:59.268831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-33c1c33a-070d-40f6-9ead-959eab8309b2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.159226 Jun 26 03:07:59.269402 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 231/453] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:07:59 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:07:59.912704 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1909c439-8dc6-408c-b4bf-b5f348f75b29 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:07:59.913309 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1909c439-8dc6-408c-b4bf-b5f348f75b29 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:07:59.919758 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1909c439-8dc6-408c-b4bf-b5f348f75b29 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:59.920188 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1909c439-8dc6-408c-b4bf-b5f348f75b29 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:07:59.920948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1909c439-8dc6-408c-b4bf-b5f348f75b29 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:07:59.921382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1909c439-8dc6-408c-b4bf-b5f348f75b29 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:00.048670 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1909c439-8dc6-408c-b4bf-b5f348f75b29 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:00.056448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1909c439-8dc6-408c-b4bf-b5f348f75b29 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:00.057958 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1909c439-8dc6-408c-b4bf-b5f348f75b29 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:00.059133 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1909c439-8dc6-408c-b4bf-b5f348f75b29 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.150344 Jun 26 03:08:00.059691 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 223/454] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:07:59 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:00.286096 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-69c42d54-1f91-4a5d-a82c-699e2cb34d33 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:00.286745 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-69c42d54-1f91-4a5d-a82c-699e2cb34d33 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:00.293904 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-69c42d54-1f91-4a5d-a82c-699e2cb34d33 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:00.294395 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-69c42d54-1f91-4a5d-a82c-699e2cb34d33 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:00.295174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-69c42d54-1f91-4a5d-a82c-699e2cb34d33 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:00.295618 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-69c42d54-1f91-4a5d-a82c-699e2cb34d33 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:00.330492 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6dd2ccf1-d8f0-48b1-a938-f3bbaf46fd76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Action: 'create', calling method: .version_select at 0x7f582c049700>, body: {"keypair": {"name": "tempest-keypair-382551666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABKMjunG8feFwrah0AvctmvFFPMhqaYlsuFg4Sdk59tQbsft5187c6TfUXHedy+rqllLzYRsF2pYytKNQyomnAtiD+9KjSLhRgDc31W1gVq6QVVvzbMSgbZiJBHl/N8Eg=="}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:08:00.344280 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-6dd2ccf1-d8f0-48b1-a938-f3bbaf46fd76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for project 1850f9f425294a82add8a09690dc1df0. Resources: {'key_pairs'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:08:00.348557 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-6dd2ccf1-d8f0-48b1-a938-f3bbaf46fd76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for user 3b7a90ca5e374fc882b644e34e0a3015 and project 1850f9f425294a82add8a09690dc1df0. Resources: {'key_pairs'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:08:00.360294 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6dd2ccf1-d8f0-48b1-a938-f3bbaf46fd76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [78caea7f-a7e3-475a-a8fe-e7406238de5a] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 26 03:08:00.425331 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-69c42d54-1f91-4a5d-a82c-699e2cb34d33 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:00.432828 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-69c42d54-1f91-4a5d-a82c-699e2cb34d33 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.151071 Jun 26 03:08:00.433395 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 232/455] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:00 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:01.077130 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-80cfb2e7-d8fe-4883-a1e6-77ffea165531 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:01.077744 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-80cfb2e7-d8fe-4883-a1e6-77ffea165531 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:01.084398 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-80cfb2e7-d8fe-4883-a1e6-77ffea165531 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:01.084852 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-80cfb2e7-d8fe-4883-a1e6-77ffea165531 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:01.085615 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-80cfb2e7-d8fe-4883-a1e6-77ffea165531 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:01.086136 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-80cfb2e7-d8fe-4883-a1e6-77ffea165531 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:01.210231 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-80cfb2e7-d8fe-4883-a1e6-77ffea165531 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:01.217935 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-80cfb2e7-d8fe-4883-a1e6-77ffea165531 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:01.219486 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-80cfb2e7-d8fe-4883-a1e6-77ffea165531 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:01.220629 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-80cfb2e7-d8fe-4883-a1e6-77ffea165531 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.147381 Jun 26 03:08:01.221179 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 233/456] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:01 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:08:01.367830 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO oslo.messaging._drivers.impl_rabbit [None req-6dd2ccf1-d8f0-48b1-a938-f3bbaf46fd76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [78caea7f-a7e3-475a-a8fe-e7406238de5a] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 53876. Jun 26 03:08:01.383155 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6dd2ccf1-d8f0-48b1-a938-f3bbaf46fd76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.056446 Jun 26 03:08:01.383756 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 224/457] 10.222.0.13 () {60 vars in 1158 bytes} [Sun Jun 26 03:08:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:08:01.449384 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-609518c5-6e83-4086-823f-19f88474a907 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:01.450071 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-609518c5-6e83-4086-823f-19f88474a907 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:01.456620 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-609518c5-6e83-4086-823f-19f88474a907 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:01.457075 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-609518c5-6e83-4086-823f-19f88474a907 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:01.457845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-609518c5-6e83-4086-823f-19f88474a907 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:01.458314 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-609518c5-6e83-4086-823f-19f88474a907 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:01.632991 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-609518c5-6e83-4086-823f-19f88474a907 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:01.641630 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-609518c5-6e83-4086-823f-19f88474a907 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.196176 Jun 26 03:08:01.642244 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 234/458] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:01 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:01.906559 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-68812529-af56-42c0-992a-c3f9d23c18a9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d65f700-d7e6-4389-8f32-7f92f9c88976", "device": "/dev/sdb"}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:08:01.908728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-68812529-af56-42c0-992a-c3f9d23c18a9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:01.915547 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-68812529-af56-42c0-992a-c3f9d23c18a9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:01.916005 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-68812529-af56-42c0-992a-c3f9d23c18a9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:01.916793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-68812529-af56-42c0-992a-c3f9d23c18a9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:01.917219 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-68812529-af56-42c0-992a-c3f9d23c18a9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:02.167566 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-68812529-af56-42c0-992a-c3f9d23c18a9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "POST /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264889 Jun 26 03:08:02.168175 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 225/459] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:08:01 2022] POST /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:08:02.238657 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-44adc164-443b-4bdd-8d9b-a0442bc35a67 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:02.239673 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-44adc164-443b-4bdd-8d9b-a0442bc35a67 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:02.247819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-44adc164-443b-4bdd-8d9b-a0442bc35a67 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:02.248365 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-44adc164-443b-4bdd-8d9b-a0442bc35a67 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:02.249907 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-44adc164-443b-4bdd-8d9b-a0442bc35a67 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:02.250630 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-44adc164-443b-4bdd-8d9b-a0442bc35a67 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:02.394361 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-44adc164-443b-4bdd-8d9b-a0442bc35a67 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:02.404516 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-44adc164-443b-4bdd-8d9b-a0442bc35a67 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:02.406404 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-44adc164-443b-4bdd-8d9b-a0442bc35a67 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:02.407856 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-44adc164-443b-4bdd-8d9b-a0442bc35a67 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.173431 Jun 26 03:08:02.409018 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 235/460] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:02 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:02.658890 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d4fece82-d58a-488d-a966-7a7a970849e0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:02.659585 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d4fece82-d58a-488d-a966-7a7a970849e0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:02.665594 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4fece82-d58a-488d-a966-7a7a970849e0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:02.666068 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4fece82-d58a-488d-a966-7a7a970849e0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:02.666841 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4fece82-d58a-488d-a966-7a7a970849e0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:02.667281 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4fece82-d58a-488d-a966-7a7a970849e0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:02.706923 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1766287320", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02cd0f74-99cd-4eb9-aeb7-aae2b7255a50"}], "security_groups": [{"name": "tempest-securitygroup--1109380243"}], "key_name": "tempest-keypair-382551666", "user_data": "}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:08:02.829495 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d4fece82-d58a-488d-a966-7a7a970849e0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:02.840755 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d4fece82-d58a-488d-a966-7a7a970849e0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.186253 Jun 26 03:08:02.841713 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 226/461] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:02 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:02.843026 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] validate_networks() for [('02cd0f74-99cd-4eb9-aeb7-aae2b7255a50', None, None, None, None, None)] {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:08:03.207039 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:08:03.207459 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:08:03.207958 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:08:03.208362 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:08:03.208770 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:08:03.218013 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:03.218490 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:03.219279 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:03.219715 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:03.243992 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for project 1850f9f425294a82add8a09690dc1df0. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:08:03.247858 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for user 3b7a90ca5e374fc882b644e34e0a3015 and project 1850f9f425294a82add8a09690dc1df0. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:08:03.258984 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:08:03.261565 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:08:03.311262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8cd05d87-adfb-4d79-bc1b-bc27b499cb9d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.609063 Jun 26 03:08:03.311898 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 236/462] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:08:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:08:03.321889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a64f848f-4938-47a4-bebd-d3c159388a40 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:03.322616 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a64f848f-4938-47a4-bebd-d3c159388a40 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:03.376793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a64f848f-4938-47a4-bebd-d3c159388a40 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:03.383771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a64f848f-4938-47a4-bebd-d3c159388a40 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1241 microversion: 2.1 time: 0.065745 Jun 26 03:08:03.384352 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 227/463] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:03 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:03.427444 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-24d75dee-8857-4788-813f-07829546f3ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:03.428060 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-24d75dee-8857-4788-813f-07829546f3ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:03.434190 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-24d75dee-8857-4788-813f-07829546f3ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:03.434645 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-24d75dee-8857-4788-813f-07829546f3ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:03.435413 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-24d75dee-8857-4788-813f-07829546f3ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:03.435852 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-24d75dee-8857-4788-813f-07829546f3ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:03.583915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-24d75dee-8857-4788-813f-07829546f3ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:03.592026 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-24d75dee-8857-4788-813f-07829546f3ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:03.593533 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-24d75dee-8857-4788-813f-07829546f3ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:03.594714 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-24d75dee-8857-4788-813f-07829546f3ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.171843 Jun 26 03:08:03.595273 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 237/464] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:03 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:03.858486 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7b66c112-f3c8-44c7-94e6-5eab60613ed2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:03.859242 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7b66c112-f3c8-44c7-94e6-5eab60613ed2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:03.871115 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7b66c112-f3c8-44c7-94e6-5eab60613ed2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:03.871820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7b66c112-f3c8-44c7-94e6-5eab60613ed2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:03.872601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7b66c112-f3c8-44c7-94e6-5eab60613ed2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:03.873071 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7b66c112-f3c8-44c7-94e6-5eab60613ed2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:04.004493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7b66c112-f3c8-44c7-94e6-5eab60613ed2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:04.012521 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-7b66c112-f3c8-44c7-94e6-5eab60613ed2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.158016 Jun 26 03:08:04.013111 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 228/465] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:03 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:04.400481 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-68fdd4bf-2604-4b20-a07f-69a87f9b7003 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:04.401115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-68fdd4bf-2604-4b20-a07f-69a87f9b7003 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:04.407484 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-68fdd4bf-2604-4b20-a07f-69a87f9b7003 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:04.407942 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-68fdd4bf-2604-4b20-a07f-69a87f9b7003 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:04.408701 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-68fdd4bf-2604-4b20-a07f-69a87f9b7003 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:04.409139 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-68fdd4bf-2604-4b20-a07f-69a87f9b7003 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:04.469193 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-68fdd4bf-2604-4b20-a07f-69a87f9b7003 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:04.476610 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-68fdd4bf-2604-4b20-a07f-69a87f9b7003 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1293 microversion: 2.1 time: 0.079883 Jun 26 03:08:04.477177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 238/466] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:04 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1293 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:04.614555 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-da67fb5f-8653-4129-b2e2-755a4b05e02b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:04.615155 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-da67fb5f-8653-4129-b2e2-755a4b05e02b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:04.621053 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-da67fb5f-8653-4129-b2e2-755a4b05e02b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:04.621498 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-da67fb5f-8653-4129-b2e2-755a4b05e02b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:04.622285 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-da67fb5f-8653-4129-b2e2-755a4b05e02b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:04.622721 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-da67fb5f-8653-4129-b2e2-755a4b05e02b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:04.757329 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-da67fb5f-8653-4129-b2e2-755a4b05e02b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:04.766402 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-da67fb5f-8653-4129-b2e2-755a4b05e02b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:04.767519 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-da67fb5f-8653-4129-b2e2-755a4b05e02b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:04.768659 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-da67fb5f-8653-4129-b2e2-755a4b05e02b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.158477 Jun 26 03:08:04.769209 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 229/467] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:04 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:05.030256 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-219da94b-c4d7-4e34-882d-79065c6fd59d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:05.030964 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-219da94b-c4d7-4e34-882d-79065c6fd59d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:05.032871 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:05.038290 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-219da94b-c4d7-4e34-882d-79065c6fd59d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:05.038752 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-219da94b-c4d7-4e34-882d-79065c6fd59d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:05.039526 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-219da94b-c4d7-4e34-882d-79065c6fd59d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:05.039964 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-219da94b-c4d7-4e34-882d-79065c6fd59d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:05.192868 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-219da94b-c4d7-4e34-882d-79065c6fd59d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:05.201067 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-219da94b-c4d7-4e34-882d-79065c6fd59d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.174780 Jun 26 03:08:05.201642 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 239/468] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:05 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:05.494245 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7bbc6389-2c6c-43ca-884b-2cc578785284 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:05.494853 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7bbc6389-2c6c-43ca-884b-2cc578785284 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:05.501649 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7bbc6389-2c6c-43ca-884b-2cc578785284 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:05.502132 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7bbc6389-2c6c-43ca-884b-2cc578785284 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:05.502900 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7bbc6389-2c6c-43ca-884b-2cc578785284 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:05.503343 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7bbc6389-2c6c-43ca-884b-2cc578785284 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:05.568792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7bbc6389-2c6c-43ca-884b-2cc578785284 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:05.576041 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-7bbc6389-2c6c-43ca-884b-2cc578785284 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1299 microversion: 2.1 time: 0.085676 Jun 26 03:08:05.576607 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 230/469] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:05 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:05.787340 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fffd89ee-c0a7-4abf-887f-d6d88850a901 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:05.788072 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fffd89ee-c0a7-4abf-887f-d6d88850a901 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:05.795494 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fffd89ee-c0a7-4abf-887f-d6d88850a901 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:05.796064 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fffd89ee-c0a7-4abf-887f-d6d88850a901 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:05.797190 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fffd89ee-c0a7-4abf-887f-d6d88850a901 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:05.797705 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fffd89ee-c0a7-4abf-887f-d6d88850a901 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:05.928552 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fffd89ee-c0a7-4abf-887f-d6d88850a901 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:05.936282 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fffd89ee-c0a7-4abf-887f-d6d88850a901 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:05.937810 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fffd89ee-c0a7-4abf-887f-d6d88850a901 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:05.938953 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fffd89ee-c0a7-4abf-887f-d6d88850a901 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.155539 Jun 26 03:08:05.940122 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 240/470] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:05 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:06.219193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-aa8174c9-1240-4fc2-98ab-27f86538ba25 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:06.219810 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-aa8174c9-1240-4fc2-98ab-27f86538ba25 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:06.226285 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aa8174c9-1240-4fc2-98ab-27f86538ba25 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:06.226741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aa8174c9-1240-4fc2-98ab-27f86538ba25 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:06.227515 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aa8174c9-1240-4fc2-98ab-27f86538ba25 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:06.227974 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aa8174c9-1240-4fc2-98ab-27f86538ba25 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:06.430934 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-aa8174c9-1240-4fc2-98ab-27f86538ba25 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:06.441666 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-aa8174c9-1240-4fc2-98ab-27f86538ba25 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.226588 Jun 26 03:08:06.442483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 231/471] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:06 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:06.592714 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2b65d1d6-a573-4e0b-a144-5f8585d69f70 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:06.593336 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2b65d1d6-a573-4e0b-a144-5f8585d69f70 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:06.600107 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2b65d1d6-a573-4e0b-a144-5f8585d69f70 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:06.600768 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2b65d1d6-a573-4e0b-a144-5f8585d69f70 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:06.601737 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2b65d1d6-a573-4e0b-a144-5f8585d69f70 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:06.602218 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2b65d1d6-a573-4e0b-a144-5f8585d69f70 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:06.820189 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-98fd6195-298f-4cde-8d6c-76a6b55438b1 req-5d9fbebf-60c9-4c76-a3ea-403dbd284787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c4e7b87-db95-47e8-8679-3a36a89d75f7", "tag": "5b9b80b1-5c7f-45d8-944b-ab893c926663"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:08:06.831862 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-98fd6195-298f-4cde-8d6c-76a6b55438b1 req-5d9fbebf-60c9-4c76-a3ea-403dbd284787 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:06.832452 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-98fd6195-298f-4cde-8d6c-76a6b55438b1 req-5d9fbebf-60c9-4c76-a3ea-403dbd284787 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:06.843477 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-2b65d1d6-a573-4e0b-a144-5f8585d69f70 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:06.852155 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-98fd6195-298f-4cde-8d6c-76a6b55438b1 req-5d9fbebf-60c9-4c76-a3ea-403dbd284787 service nova] Creating event network-changed:5b9b80b1-5c7f-45d8-944b-ab893c926663 for instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 on hv-cinder-84684 Jun 26 03:08:06.859250 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2b65d1d6-a573-4e0b-a144-5f8585d69f70 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.270164 Jun 26 03:08:06.859673 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 241/472] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:06 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:06.865162 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-98fd6195-298f-4cde-8d6c-76a6b55438b1 req-5d9fbebf-60c9-4c76-a3ea-403dbd284787 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050637 Jun 26 03:08:06.867464 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 232/473] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:08:06.958031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a7cfbffa-6c8c-4343-a0ae-a334dfad3c57 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:06.958673 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a7cfbffa-6c8c-4343-a0ae-a334dfad3c57 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:06.964762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a7cfbffa-6c8c-4343-a0ae-a334dfad3c57 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:06.965298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a7cfbffa-6c8c-4343-a0ae-a334dfad3c57 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:06.965934 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a7cfbffa-6c8c-4343-a0ae-a334dfad3c57 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:06.966412 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a7cfbffa-6c8c-4343-a0ae-a334dfad3c57 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:06.982031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=100 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:07.419570 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a7cfbffa-6c8c-4343-a0ae-a334dfad3c57 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:07.427611 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a7cfbffa-6c8c-4343-a0ae-a334dfad3c57 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:07.429129 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a7cfbffa-6c8c-4343-a0ae-a334dfad3c57 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:07.430330 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a7cfbffa-6c8c-4343-a0ae-a334dfad3c57 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.476147 Jun 26 03:08:07.430890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 242/474] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:06 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:07.467273 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-21498d3e-d263-4a4b-80a5-f35094511858 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:07.467962 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-21498d3e-d263-4a4b-80a5-f35094511858 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:07.476362 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-21498d3e-d263-4a4b-80a5-f35094511858 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:07.476810 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-21498d3e-d263-4a4b-80a5-f35094511858 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:07.477622 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-21498d3e-d263-4a4b-80a5-f35094511858 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:07.478172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-21498d3e-d263-4a4b-80a5-f35094511858 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:07.677352 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-21498d3e-d263-4a4b-80a5-f35094511858 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:07.685945 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-21498d3e-d263-4a4b-80a5-f35094511858 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.222760 Jun 26 03:08:07.686564 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 233/475] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:07 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:07.877035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-76898b23-f0c7-41f0-8099-3d40bd3f7dcb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:07.877646 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-76898b23-f0c7-41f0-8099-3d40bd3f7dcb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:07.884417 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-76898b23-f0c7-41f0-8099-3d40bd3f7dcb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:07.884871 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-76898b23-f0c7-41f0-8099-3d40bd3f7dcb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:07.885625 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-76898b23-f0c7-41f0-8099-3d40bd3f7dcb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:07.886082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-76898b23-f0c7-41f0-8099-3d40bd3f7dcb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:08.015510 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-76898b23-f0c7-41f0-8099-3d40bd3f7dcb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:08.023589 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-76898b23-f0c7-41f0-8099-3d40bd3f7dcb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.150899 Jun 26 03:08:08.024168 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 243/476] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:07 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:08.448572 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1f90fb32-a694-4954-bc36-affb13b383d3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:08.449177 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1f90fb32-a694-4954-bc36-affb13b383d3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:08.455516 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1f90fb32-a694-4954-bc36-affb13b383d3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:08.455965 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1f90fb32-a694-4954-bc36-affb13b383d3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:08.456722 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1f90fb32-a694-4954-bc36-affb13b383d3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:08.457169 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1f90fb32-a694-4954-bc36-affb13b383d3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:08.583867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1f90fb32-a694-4954-bc36-affb13b383d3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:08.591648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1f90fb32-a694-4954-bc36-affb13b383d3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:08.593134 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1f90fb32-a694-4954-bc36-affb13b383d3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:08.594311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1f90fb32-a694-4954-bc36-affb13b383d3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.149665 Jun 26 03:08:08.594860 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 234/477] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:08 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:08.702163 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ad47f221-7700-47fc-9065-a5ac13945ffb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:08.702772 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ad47f221-7700-47fc-9065-a5ac13945ffb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:08.708659 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ad47f221-7700-47fc-9065-a5ac13945ffb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:08.709108 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ad47f221-7700-47fc-9065-a5ac13945ffb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:08.709862 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ad47f221-7700-47fc-9065-a5ac13945ffb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:08.710320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ad47f221-7700-47fc-9065-a5ac13945ffb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:08.836785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ad47f221-7700-47fc-9065-a5ac13945ffb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:08.847810 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ad47f221-7700-47fc-9065-a5ac13945ffb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.149224 Jun 26 03:08:08.848433 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 244/478] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:08 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:09.039995 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d6e8667a-0769-4c8f-a161-4cf42af3a583 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:09.040636 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d6e8667a-0769-4c8f-a161-4cf42af3a583 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:09.046633 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d6e8667a-0769-4c8f-a161-4cf42af3a583 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:09.047083 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d6e8667a-0769-4c8f-a161-4cf42af3a583 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:09.047845 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d6e8667a-0769-4c8f-a161-4cf42af3a583 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:09.048283 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d6e8667a-0769-4c8f-a161-4cf42af3a583 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:09.172135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d6e8667a-0769-4c8f-a161-4cf42af3a583 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:09.179441 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d6e8667a-0769-4c8f-a161-4cf42af3a583 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.143340 Jun 26 03:08:09.180005 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 235/479] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:09 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:09.613198 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6f2b069b-dde1-4fc5-97f6-85d8057a8eb1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:09.614344 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-6f2b069b-dde1-4fc5-97f6-85d8057a8eb1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:09.620852 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6f2b069b-dde1-4fc5-97f6-85d8057a8eb1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:09.621307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6f2b069b-dde1-4fc5-97f6-85d8057a8eb1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:09.622101 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6f2b069b-dde1-4fc5-97f6-85d8057a8eb1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:09.622547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6f2b069b-dde1-4fc5-97f6-85d8057a8eb1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:09.749819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6f2b069b-dde1-4fc5-97f6-85d8057a8eb1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:09.758588 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6f2b069b-dde1-4fc5-97f6-85d8057a8eb1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:09.760099 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6f2b069b-dde1-4fc5-97f6-85d8057a8eb1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:09.761257 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6f2b069b-dde1-4fc5-97f6-85d8057a8eb1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.152608 Jun 26 03:08:09.761808 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 245/480] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:09 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:09.865176 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-787f7cba-34ab-4be2-857e-d030941c5a7a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:09.865793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-787f7cba-34ab-4be2-857e-d030941c5a7a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:09.872326 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-787f7cba-34ab-4be2-857e-d030941c5a7a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:09.872777 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-787f7cba-34ab-4be2-857e-d030941c5a7a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:09.873544 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-787f7cba-34ab-4be2-857e-d030941c5a7a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:09.873981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-787f7cba-34ab-4be2-857e-d030941c5a7a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:10.017173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-787f7cba-34ab-4be2-857e-d030941c5a7a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:10.025795 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-787f7cba-34ab-4be2-857e-d030941c5a7a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.164939 Jun 26 03:08:10.026478 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 236/481] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:09 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:10.125706 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-08c3061a-1426-4c71-b880-b9cb8451b517 req-894ad344-d748-4916-bd86-b0abf7d8cdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0d1d9b-d025-442c-a2f6-db22050d9059", "name": "network-vif-plugged", "status": "completed", "tag": "52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:08:10.134157 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-08c3061a-1426-4c71-b880-b9cb8451b517 req-894ad344-d748-4916-bd86-b0abf7d8cdb8 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:10.134606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-08c3061a-1426-4c71-b880-b9cb8451b517 req-894ad344-d748-4916-bd86-b0abf7d8cdb8 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:10.145764 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-08c3061a-1426-4c71-b880-b9cb8451b517 req-894ad344-d748-4916-bd86-b0abf7d8cdb8 service nova] Creating event network-vif-plugged:52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f for instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 on hv-cinder-84684 Jun 26 03:08:10.150841 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-08c3061a-1426-4c71-b880-b9cb8451b517 req-894ad344-d748-4916-bd86-b0abf7d8cdb8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028768 Jun 26 03:08:10.151502 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 246/482] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:08:10.195961 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-77155a9a-824b-45a8-a635-f14668856d32 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:10.196563 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-77155a9a-824b-45a8-a635-f14668856d32 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:10.202565 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-77155a9a-824b-45a8-a635-f14668856d32 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:10.203015 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-77155a9a-824b-45a8-a635-f14668856d32 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:10.203763 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-77155a9a-824b-45a8-a635-f14668856d32 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:10.204196 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-77155a9a-824b-45a8-a635-f14668856d32 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:10.341518 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-77155a9a-824b-45a8-a635-f14668856d32 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:10.349440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-77155a9a-824b-45a8-a635-f14668856d32 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.157286 Jun 26 03:08:10.350003 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 237/483] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:10 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:10.780537 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b3f49117-948b-4d5a-9727-5d0a81e492bb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:10.781189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b3f49117-948b-4d5a-9727-5d0a81e492bb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:10.787969 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b3f49117-948b-4d5a-9727-5d0a81e492bb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:10.788421 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b3f49117-948b-4d5a-9727-5d0a81e492bb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:10.789195 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b3f49117-948b-4d5a-9727-5d0a81e492bb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:10.789620 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b3f49117-948b-4d5a-9727-5d0a81e492bb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:10.919923 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b3f49117-948b-4d5a-9727-5d0a81e492bb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:10.928192 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b3f49117-948b-4d5a-9727-5d0a81e492bb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:10.929695 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b3f49117-948b-4d5a-9727-5d0a81e492bb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:10.930879 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b3f49117-948b-4d5a-9727-5d0a81e492bb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.155112 Jun 26 03:08:10.931437 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 247/484] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:10 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:11.042390 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-cf9c1bd4-5f12-44cc-be06-6c3ed5a3c771 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:11.042937 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-cf9c1bd4-5f12-44cc-be06-6c3ed5a3c771 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:11.049880 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cf9c1bd4-5f12-44cc-be06-6c3ed5a3c771 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:11.050420 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cf9c1bd4-5f12-44cc-be06-6c3ed5a3c771 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:11.051194 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cf9c1bd4-5f12-44cc-be06-6c3ed5a3c771 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:11.051629 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cf9c1bd4-5f12-44cc-be06-6c3ed5a3c771 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:11.069173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:11.180732 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-cf9c1bd4-5f12-44cc-be06-6c3ed5a3c771 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:11.188546 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-cf9c1bd4-5f12-44cc-be06-6c3ed5a3c771 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1724 microversion: 2.1 time: 0.150068 Jun 26 03:08:11.189119 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 238/485] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:11 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:11.366196 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4ea994a8-7f43-4dc5-b469-7e6028d4974a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:11.366734 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4ea994a8-7f43-4dc5-b469-7e6028d4974a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:11.372750 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4ea994a8-7f43-4dc5-b469-7e6028d4974a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:11.373204 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4ea994a8-7f43-4dc5-b469-7e6028d4974a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:11.373961 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4ea994a8-7f43-4dc5-b469-7e6028d4974a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:11.374429 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4ea994a8-7f43-4dc5-b469-7e6028d4974a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:11.501347 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4ea994a8-7f43-4dc5-b469-7e6028d4974a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:11.509672 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4ea994a8-7f43-4dc5-b469-7e6028d4974a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.147435 Jun 26 03:08:11.510269 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 248/486] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:11 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:11.949244 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4995ef48-5fbd-4d8f-800c-30996b7d7dee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:11.949780 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4995ef48-5fbd-4d8f-800c-30996b7d7dee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:11.955931 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4995ef48-5fbd-4d8f-800c-30996b7d7dee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:11.956382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4995ef48-5fbd-4d8f-800c-30996b7d7dee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:11.957138 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4995ef48-5fbd-4d8f-800c-30996b7d7dee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:11.957572 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4995ef48-5fbd-4d8f-800c-30996b7d7dee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:12.084732 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4995ef48-5fbd-4d8f-800c-30996b7d7dee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:12.092583 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4995ef48-5fbd-4d8f-800c-30996b7d7dee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:12.094134 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4995ef48-5fbd-4d8f-800c-30996b7d7dee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:12.095300 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4995ef48-5fbd-4d8f-800c-30996b7d7dee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.150034 Jun 26 03:08:12.095859 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 239/487] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:11 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:12.205869 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-36dfc09e-4696-4052-87cb-2ff8a288e3f1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:12.206455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-36dfc09e-4696-4052-87cb-2ff8a288e3f1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:12.212705 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-36dfc09e-4696-4052-87cb-2ff8a288e3f1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:12.213155 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-36dfc09e-4696-4052-87cb-2ff8a288e3f1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:12.213912 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-36dfc09e-4696-4052-87cb-2ff8a288e3f1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:12.214372 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-36dfc09e-4696-4052-87cb-2ff8a288e3f1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:12.411722 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-36dfc09e-4696-4052-87cb-2ff8a288e3f1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:12.419649 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-36dfc09e-4696-4052-87cb-2ff8a288e3f1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1701 microversion: 2.1 time: 0.217813 Jun 26 03:08:12.426419 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 249/488] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:12 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1701 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:12.436680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9cef2fe8-4d04-4bf3-a184-944c9d3f705a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:08:12.442604 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9cef2fe8-4d04-4bf3-a184-944c9d3f705a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:12.443053 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9cef2fe8-4d04-4bf3-a184-944c9d3f705a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:12.464213 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9cef2fe8-4d04-4bf3-a184-944c9d3f705a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Going to try to start instance {{(pid=117782) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 26 03:08:12.504353 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9cef2fe8-4d04-4bf3-a184-944c9d3f705a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "POST /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.071419 Jun 26 03:08:12.504936 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 240/489] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:08:12 2022] POST /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:08:12.512933 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-046748e7-0bb6-4faa-b337-ad7374272b27 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:12.513550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-046748e7-0bb6-4faa-b337-ad7374272b27 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:12.519464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-046748e7-0bb6-4faa-b337-ad7374272b27 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:12.519916 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-046748e7-0bb6-4faa-b337-ad7374272b27 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:12.520668 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-046748e7-0bb6-4faa-b337-ad7374272b27 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:12.521101 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-046748e7-0bb6-4faa-b337-ad7374272b27 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:12.527205 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-acc12739-6c92-49ae-9d71-1167746d96ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:12.527910 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-acc12739-6c92-49ae-9d71-1167746d96ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:12.534548 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-acc12739-6c92-49ae-9d71-1167746d96ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:12.535001 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-acc12739-6c92-49ae-9d71-1167746d96ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:12.535764 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-acc12739-6c92-49ae-9d71-1167746d96ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:12.536205 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-acc12739-6c92-49ae-9d71-1167746d96ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:12.719163 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-046748e7-0bb6-4faa-b337-ad7374272b27 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:12.723723 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-acc12739-6c92-49ae-9d71-1167746d96ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:12.727568 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-046748e7-0bb6-4faa-b337-ad7374272b27 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1710 microversion: 2.1 time: 0.218398 Jun 26 03:08:12.728133 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 250/490] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:12 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1710 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:12.731122 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-acc12739-6c92-49ae-9d71-1167746d96ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.208016 Jun 26 03:08:12.731684 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 241/491] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:12 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:08:13.113200 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-db19ffe6-ee84-4be3-8c69-af84c6ede977 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:13.114109 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-db19ffe6-ee84-4be3-8c69-af84c6ede977 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:13.125359 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-db19ffe6-ee84-4be3-8c69-af84c6ede977 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:13.126280 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-db19ffe6-ee84-4be3-8c69-af84c6ede977 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:13.127136 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-db19ffe6-ee84-4be3-8c69-af84c6ede977 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:13.127725 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-db19ffe6-ee84-4be3-8c69-af84c6ede977 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:13.228046 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=2 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:13.255060 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=6 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:13.474557 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-db19ffe6-ee84-4be3-8c69-af84c6ede977 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:13.482417 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-db19ffe6-ee84-4be3-8c69-af84c6ede977 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:13.483908 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-db19ffe6-ee84-4be3-8c69-af84c6ede977 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:13.485048 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-db19ffe6-ee84-4be3-8c69-af84c6ede977 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.375724 Jun 26 03:08:13.487440 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 251/492] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:13 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:13.748402 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c0c6ccbd-64ba-4fe3-9d70-72f87a525fb8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:13.748591 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ce2c6fe7-ace1-4e3c-a4ce-9628c71184a1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:13.749033 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c0c6ccbd-64ba-4fe3-9d70-72f87a525fb8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:13.749397 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ce2c6fe7-ace1-4e3c-a4ce-9628c71184a1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:13.751960 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=6 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:13.755601 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c0c6ccbd-64ba-4fe3-9d70-72f87a525fb8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:13.756114 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c0c6ccbd-64ba-4fe3-9d70-72f87a525fb8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:13.757047 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c0c6ccbd-64ba-4fe3-9d70-72f87a525fb8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:13.757495 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c0c6ccbd-64ba-4fe3-9d70-72f87a525fb8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:13.758723 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ce2c6fe7-ace1-4e3c-a4ce-9628c71184a1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:13.759185 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ce2c6fe7-ace1-4e3c-a4ce-9628c71184a1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:13.760108 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ce2c6fe7-ace1-4e3c-a4ce-9628c71184a1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:13.760583 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ce2c6fe7-ace1-4e3c-a4ce-9628c71184a1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:14.029470 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c0c6ccbd-64ba-4fe3-9d70-72f87a525fb8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:14.037641 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c0c6ccbd-64ba-4fe3-9d70-72f87a525fb8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.293875 Jun 26 03:08:14.038243 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 252/493] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:13 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:14.076548 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ce2c6fe7-ace1-4e3c-a4ce-9628c71184a1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:14.089992 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ce2c6fe7-ace1-4e3c-a4ce-9628c71184a1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1710 microversion: 2.1 time: 0.348907 Jun 26 03:08:14.090591 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 242/494] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:13 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1710 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:14.505931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-987ee65f-2565-4499-9581-e57d4dd3737e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:14.506678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-987ee65f-2565-4499-9581-e57d4dd3737e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:14.513038 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-987ee65f-2565-4499-9581-e57d4dd3737e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:14.513490 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-987ee65f-2565-4499-9581-e57d4dd3737e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:14.514275 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-987ee65f-2565-4499-9581-e57d4dd3737e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:14.514713 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-987ee65f-2565-4499-9581-e57d4dd3737e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:14.644319 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-987ee65f-2565-4499-9581-e57d4dd3737e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:14.652853 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-987ee65f-2565-4499-9581-e57d4dd3737e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:14.654528 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-987ee65f-2565-4499-9581-e57d4dd3737e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:14.655940 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-987ee65f-2565-4499-9581-e57d4dd3737e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.154582 Jun 26 03:08:14.656618 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 253/495] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:14 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:14.764232 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-b936d88a-7b16-4014-9a1d-e28cbf9df31d req-e846743d-d3cd-4203-87fd-7fcef74f0b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4e7b87-db95-47e8-8679-3a36a89d75f7", "name": "network-vif-plugged", "status": "completed", "tag": "5b9b80b1-5c7f-45d8-944b-ab893c926663"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:08:14.773875 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-b936d88a-7b16-4014-9a1d-e28cbf9df31d req-e846743d-d3cd-4203-87fd-7fcef74f0b1f service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:14.774930 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-b936d88a-7b16-4014-9a1d-e28cbf9df31d req-e846743d-d3cd-4203-87fd-7fcef74f0b1f service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:14.785841 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-b936d88a-7b16-4014-9a1d-e28cbf9df31d req-e846743d-d3cd-4203-87fd-7fcef74f0b1f service nova] Creating event network-vif-plugged:5b9b80b1-5c7f-45d8-944b-ab893c926663 for instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 on hv-cinder-84684 Jun 26 03:08:14.790659 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-b936d88a-7b16-4014-9a1d-e28cbf9df31d req-e846743d-d3cd-4203-87fd-7fcef74f0b1f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030175 Jun 26 03:08:14.791258 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 243/496] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:08:15.054594 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-98b83b57-688b-4eb3-a94a-de50a8b99158 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:15.055120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-98b83b57-688b-4eb3-a94a-de50a8b99158 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:15.061448 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-98b83b57-688b-4eb3-a94a-de50a8b99158 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:15.061895 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-98b83b57-688b-4eb3-a94a-de50a8b99158 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:15.062684 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-98b83b57-688b-4eb3-a94a-de50a8b99158 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:15.063143 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-98b83b57-688b-4eb3-a94a-de50a8b99158 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:15.107809 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-31ba2bfa-3de0-46e6-bd52-050a3bd190c9 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:15.108510 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-31ba2bfa-3de0-46e6-bd52-050a3bd190c9 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:15.115256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31ba2bfa-3de0-46e6-bd52-050a3bd190c9 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:15.115805 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31ba2bfa-3de0-46e6-bd52-050a3bd190c9 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:15.116650 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31ba2bfa-3de0-46e6-bd52-050a3bd190c9 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:15.117148 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31ba2bfa-3de0-46e6-bd52-050a3bd190c9 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:15.247646 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-98b83b57-688b-4eb3-a94a-de50a8b99158 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:15.255934 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-98b83b57-688b-4eb3-a94a-de50a8b99158 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.205248 Jun 26 03:08:15.256511 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 254/497] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:15 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:15.277945 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-31ba2bfa-3de0-46e6-bd52-050a3bd190c9 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:15.285991 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-31ba2bfa-3de0-46e6-bd52-050a3bd190c9 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1710 microversion: 2.1 time: 0.182327 Jun 26 03:08:15.286578 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 244/498] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:15 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1710 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:15.674644 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f9add55e-105f-40df-97db-1d16296d1843 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:15.675263 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f9add55e-105f-40df-97db-1d16296d1843 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:15.682642 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9add55e-105f-40df-97db-1d16296d1843 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:15.683125 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9add55e-105f-40df-97db-1d16296d1843 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:15.683896 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9add55e-105f-40df-97db-1d16296d1843 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:15.684349 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9add55e-105f-40df-97db-1d16296d1843 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:15.810097 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f9add55e-105f-40df-97db-1d16296d1843 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:15.817803 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f9add55e-105f-40df-97db-1d16296d1843 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:15.819324 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f9add55e-105f-40df-97db-1d16296d1843 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:15.820458 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f9add55e-105f-40df-97db-1d16296d1843 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.149758 Jun 26 03:08:15.821011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 255/499] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:15 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:16.273531 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-56866006-1019-4699-a2a4-4ce5c28c3204 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:16.274210 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-56866006-1019-4699-a2a4-4ce5c28c3204 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:16.280807 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-56866006-1019-4699-a2a4-4ce5c28c3204 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:16.281251 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-56866006-1019-4699-a2a4-4ce5c28c3204 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:16.282005 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-56866006-1019-4699-a2a4-4ce5c28c3204 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:16.282489 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-56866006-1019-4699-a2a4-4ce5c28c3204 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:16.303577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a18f5658-f40f-4db5-8413-7d29e97b0b99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:16.304402 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a18f5658-f40f-4db5-8413-7d29e97b0b99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:16.310701 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a18f5658-f40f-4db5-8413-7d29e97b0b99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:16.311153 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a18f5658-f40f-4db5-8413-7d29e97b0b99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:16.311917 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a18f5658-f40f-4db5-8413-7d29e97b0b99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:16.312353 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a18f5658-f40f-4db5-8413-7d29e97b0b99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:16.480334 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-56866006-1019-4699-a2a4-4ce5c28c3204 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:16.483152 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a18f5658-f40f-4db5-8413-7d29e97b0b99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:16.489206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-56866006-1019-4699-a2a4-4ce5c28c3204 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.219644 Jun 26 03:08:16.489786 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 245/500] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:16 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:16.491949 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a18f5658-f40f-4db5-8413-7d29e97b0b99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1710 microversion: 2.1 time: 0.192325 Jun 26 03:08:16.492738 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 256/501] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:16 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1710 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:08:16.838445 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-0452570a-5222-4bcf-90aa-3cfb416145a9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:16.838978 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-0452570a-5222-4bcf-90aa-3cfb416145a9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:16.844931 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0452570a-5222-4bcf-90aa-3cfb416145a9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:16.845869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0452570a-5222-4bcf-90aa-3cfb416145a9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:16.846660 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0452570a-5222-4bcf-90aa-3cfb416145a9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:16.847101 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0452570a-5222-4bcf-90aa-3cfb416145a9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:16.975788 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-0452570a-5222-4bcf-90aa-3cfb416145a9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:16.983529 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-0452570a-5222-4bcf-90aa-3cfb416145a9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:16.985013 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-0452570a-5222-4bcf-90aa-3cfb416145a9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:16.986784 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-0452570a-5222-4bcf-90aa-3cfb416145a9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.152507 Jun 26 03:08:16.987339 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 246/502] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:16 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:17.506947 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0addac50-2244-4d12-9f47-41cf60b874c5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:17.507506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0addac50-2244-4d12-9f47-41cf60b874c5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:17.509907 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-66509d57-06ab-489e-afe2-ddaae602dc62 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:17.510557 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-66509d57-06ab-489e-afe2-ddaae602dc62 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:17.513898 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0addac50-2244-4d12-9f47-41cf60b874c5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:17.514386 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0addac50-2244-4d12-9f47-41cf60b874c5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:17.515143 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0addac50-2244-4d12-9f47-41cf60b874c5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:17.515581 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0addac50-2244-4d12-9f47-41cf60b874c5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:17.516880 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-66509d57-06ab-489e-afe2-ddaae602dc62 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:17.517914 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-66509d57-06ab-489e-afe2-ddaae602dc62 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:17.518708 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-66509d57-06ab-489e-afe2-ddaae602dc62 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:17.519147 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-66509d57-06ab-489e-afe2-ddaae602dc62 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:17.703324 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0addac50-2244-4d12-9f47-41cf60b874c5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:17.710703 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-66509d57-06ab-489e-afe2-ddaae602dc62 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:17.711646 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0addac50-2244-4d12-9f47-41cf60b874c5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.208818 Jun 26 03:08:17.712430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 257/503] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:17 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:17.719295 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-66509d57-06ab-489e-afe2-ddaae602dc62 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1710 microversion: 2.1 time: 0.213085 Jun 26 03:08:17.719944 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 247/504] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:17 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1710 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:08:18.006669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9a7ff7df-8d86-4fc0-8be1-5725feb686a4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:18.007288 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9a7ff7df-8d86-4fc0-8be1-5725feb686a4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:18.013215 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9a7ff7df-8d86-4fc0-8be1-5725feb686a4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:18.013664 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9a7ff7df-8d86-4fc0-8be1-5725feb686a4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:18.014461 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9a7ff7df-8d86-4fc0-8be1-5725feb686a4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:18.014900 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9a7ff7df-8d86-4fc0-8be1-5725feb686a4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:18.138326 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9a7ff7df-8d86-4fc0-8be1-5725feb686a4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:18.146152 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9a7ff7df-8d86-4fc0-8be1-5725feb686a4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:18.147661 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9a7ff7df-8d86-4fc0-8be1-5725feb686a4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:18.148805 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9a7ff7df-8d86-4fc0-8be1-5725feb686a4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.146260 Jun 26 03:08:18.149357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 258/505] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:18 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:18.729655 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fed026ae-e964-4628-ae84-d6b3b57a984e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:18.730234 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-fed026ae-e964-4628-ae84-d6b3b57a984e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:18.735963 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d3878e34-81f6-496c-b46a-b48132227af8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:18.736675 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d3878e34-81f6-496c-b46a-b48132227af8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:18.737071 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fed026ae-e964-4628-ae84-d6b3b57a984e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:18.737525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fed026ae-e964-4628-ae84-d6b3b57a984e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:18.738325 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fed026ae-e964-4628-ae84-d6b3b57a984e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:18.738759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fed026ae-e964-4628-ae84-d6b3b57a984e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:18.742981 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d3878e34-81f6-496c-b46a-b48132227af8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:18.743439 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d3878e34-81f6-496c-b46a-b48132227af8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:18.744212 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d3878e34-81f6-496c-b46a-b48132227af8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:18.744654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d3878e34-81f6-496c-b46a-b48132227af8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:18.932569 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-fed026ae-e964-4628-ae84-d6b3b57a984e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:18.935642 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d3878e34-81f6-496c-b46a-b48132227af8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:18.937806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=100 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:18.940285 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-fed026ae-e964-4628-ae84-d6b3b57a984e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.214442 Jun 26 03:08:18.940854 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 248/506] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:18 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:18.944784 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d3878e34-81f6-496c-b46a-b48132227af8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1710 microversion: 2.1 time: 0.212632 Jun 26 03:08:18.945343 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 259/507] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:18 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1710 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:08:19.168746 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-20c92799-b7a6-48b4-9370-0bc39243dd60 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:19.169355 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-20c92799-b7a6-48b4-9370-0bc39243dd60 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:19.175496 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-20c92799-b7a6-48b4-9370-0bc39243dd60 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:19.176209 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-20c92799-b7a6-48b4-9370-0bc39243dd60 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:19.176970 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-20c92799-b7a6-48b4-9370-0bc39243dd60 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:19.177403 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-20c92799-b7a6-48b4-9370-0bc39243dd60 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:19.312889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-20c92799-b7a6-48b4-9370-0bc39243dd60 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:19.321677 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-20c92799-b7a6-48b4-9370-0bc39243dd60 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:19.323276 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-20c92799-b7a6-48b4-9370-0bc39243dd60 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:19.324430 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-20c92799-b7a6-48b4-9370-0bc39243dd60 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.161443 Jun 26 03:08:19.334212 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 249/508] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:19 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:19.956868 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-12645f6b-27aa-484f-9eef-71c0c0386fad tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:19.957494 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-12645f6b-27aa-484f-9eef-71c0c0386fad tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:19.961593 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-eaf69212-0282-4674-b81c-99f1ba4709c0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:19.962240 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-eaf69212-0282-4674-b81c-99f1ba4709c0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:19.964090 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-12645f6b-27aa-484f-9eef-71c0c0386fad tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:19.964540 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-12645f6b-27aa-484f-9eef-71c0c0386fad tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:19.965301 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-12645f6b-27aa-484f-9eef-71c0c0386fad tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:19.965733 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-12645f6b-27aa-484f-9eef-71c0c0386fad tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:19.968626 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eaf69212-0282-4674-b81c-99f1ba4709c0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:19.969084 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eaf69212-0282-4674-b81c-99f1ba4709c0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:19.969845 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eaf69212-0282-4674-b81c-99f1ba4709c0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:19.970932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eaf69212-0282-4674-b81c-99f1ba4709c0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:20.158509 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-12645f6b-27aa-484f-9eef-71c0c0386fad tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:20.161543 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-eaf69212-0282-4674-b81c-99f1ba4709c0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:20.165965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-12645f6b-27aa-484f-9eef-71c0c0386fad tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.212914 Jun 26 03:08:20.166558 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 260/509] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:19 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:20.169519 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-eaf69212-0282-4674-b81c-99f1ba4709c0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1714 microversion: 2.1 time: 0.211755 Jun 26 03:08:20.170088 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 250/510] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:19 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1714 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:08:20.343345 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4b3146ac-b493-4c41-9399-154af2eb2739 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:20.343959 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4b3146ac-b493-4c41-9399-154af2eb2739 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:20.350551 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4b3146ac-b493-4c41-9399-154af2eb2739 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:20.351004 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4b3146ac-b493-4c41-9399-154af2eb2739 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:20.351768 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4b3146ac-b493-4c41-9399-154af2eb2739 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:20.352215 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4b3146ac-b493-4c41-9399-154af2eb2739 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:20.480382 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4b3146ac-b493-4c41-9399-154af2eb2739 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:20.488288 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4b3146ac-b493-4c41-9399-154af2eb2739 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:20.489795 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4b3146ac-b493-4c41-9399-154af2eb2739 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:20.490982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4b3146ac-b493-4c41-9399-154af2eb2739 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.151547 Jun 26 03:08:20.491539 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 261/511] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:20 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:21.185585 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9108340a-fdb8-44aa-bbac-c19c2129f97f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:21.186380 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9108340a-fdb8-44aa-bbac-c19c2129f97f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:21.193601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9108340a-fdb8-44aa-bbac-c19c2129f97f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:21.194065 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9108340a-fdb8-44aa-bbac-c19c2129f97f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:21.194833 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9108340a-fdb8-44aa-bbac-c19c2129f97f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:21.195265 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9108340a-fdb8-44aa-bbac-c19c2129f97f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:21.319272 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9108340a-fdb8-44aa-bbac-c19c2129f97f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:21.326474 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9108340a-fdb8-44aa-bbac-c19c2129f97f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.147489 Jun 26 03:08:21.327037 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 251/512] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:21 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:21.509266 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-00889658-5364-47dc-a028-e28cf017692a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:21.509905 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-00889658-5364-47dc-a028-e28cf017692a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:21.516329 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00889658-5364-47dc-a028-e28cf017692a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:21.516782 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00889658-5364-47dc-a028-e28cf017692a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:21.518164 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00889658-5364-47dc-a028-e28cf017692a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:21.518604 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00889658-5364-47dc-a028-e28cf017692a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:21.645196 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-00889658-5364-47dc-a028-e28cf017692a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:21.652977 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-00889658-5364-47dc-a028-e28cf017692a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:21.654509 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-00889658-5364-47dc-a028-e28cf017692a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:21.655655 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-00889658-5364-47dc-a028-e28cf017692a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.150275 Jun 26 03:08:21.656216 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 262/513] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:21 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:22.342779 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b03d6148-ae75-4ea2-b6d5-d6e1d852dda9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:22.343373 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b03d6148-ae75-4ea2-b6d5-d6e1d852dda9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:22.350338 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b03d6148-ae75-4ea2-b6d5-d6e1d852dda9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:22.350787 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b03d6148-ae75-4ea2-b6d5-d6e1d852dda9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:22.351541 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b03d6148-ae75-4ea2-b6d5-d6e1d852dda9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:22.351975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b03d6148-ae75-4ea2-b6d5-d6e1d852dda9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:22.479066 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b03d6148-ae75-4ea2-b6d5-d6e1d852dda9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:22.486385 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b03d6148-ae75-4ea2-b6d5-d6e1d852dda9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.147383 Jun 26 03:08:22.486933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 252/514] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:22 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:22.674288 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-76d6da71-524f-400c-bff6-381bcda06d2b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:22.674909 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-76d6da71-524f-400c-bff6-381bcda06d2b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:22.681447 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-76d6da71-524f-400c-bff6-381bcda06d2b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:22.681892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-76d6da71-524f-400c-bff6-381bcda06d2b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:22.682688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-76d6da71-524f-400c-bff6-381bcda06d2b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:22.683130 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-76d6da71-524f-400c-bff6-381bcda06d2b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:22.811282 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-76d6da71-524f-400c-bff6-381bcda06d2b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:22.819608 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-76d6da71-524f-400c-bff6-381bcda06d2b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:22.821125 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-76d6da71-524f-400c-bff6-381bcda06d2b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:22.822311 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-76d6da71-524f-400c-bff6-381bcda06d2b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.151992 Jun 26 03:08:22.822871 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 263/515] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:22 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:23.503278 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c7526753-4ad3-4e1b-a937-8978f823c250 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:23.504158 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c7526753-4ad3-4e1b-a937-8978f823c250 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:23.510591 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c7526753-4ad3-4e1b-a937-8978f823c250 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:23.511046 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c7526753-4ad3-4e1b-a937-8978f823c250 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:23.511807 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c7526753-4ad3-4e1b-a937-8978f823c250 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:23.512246 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c7526753-4ad3-4e1b-a937-8978f823c250 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:23.636725 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c7526753-4ad3-4e1b-a937-8978f823c250 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:23.644612 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c7526753-4ad3-4e1b-a937-8978f823c250 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.145602 Jun 26 03:08:23.645177 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 253/516] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:23 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:23.841532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-de3181c2-d0d7-426a-a002-2f406e81e20f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:23.842430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-de3181c2-d0d7-426a-a002-2f406e81e20f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:23.848852 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-de3181c2-d0d7-426a-a002-2f406e81e20f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:23.849280 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-de3181c2-d0d7-426a-a002-2f406e81e20f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:23.850061 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-de3181c2-d0d7-426a-a002-2f406e81e20f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:23.850492 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-de3181c2-d0d7-426a-a002-2f406e81e20f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:23.976980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-de3181c2-d0d7-426a-a002-2f406e81e20f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:23.984704 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-de3181c2-d0d7-426a-a002-2f406e81e20f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:23.986774 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-de3181c2-d0d7-426a-a002-2f406e81e20f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:23.987909 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-de3181c2-d0d7-426a-a002-2f406e81e20f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.150338 Jun 26 03:08:23.988465 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 264/517] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:23 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:24.661302 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e408da71-8e96-46b2-a389-92a0484a5a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:24.661921 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e408da71-8e96-46b2-a389-92a0484a5a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:24.668401 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e408da71-8e96-46b2-a389-92a0484a5a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:24.668855 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e408da71-8e96-46b2-a389-92a0484a5a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:24.669613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e408da71-8e96-46b2-a389-92a0484a5a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:24.670066 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e408da71-8e96-46b2-a389-92a0484a5a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:24.796027 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e408da71-8e96-46b2-a389-92a0484a5a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:24.799568 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:24.804425 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e408da71-8e96-46b2-a389-92a0484a5a75 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1367 microversion: 2.1 time: 0.147527 Jun 26 03:08:24.804994 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 254/518] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:24 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:25.007059 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b071b4dd-c75a-4726-9684-520e9bdd30f0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:25.007678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b071b4dd-c75a-4726-9684-520e9bdd30f0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:25.014196 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b071b4dd-c75a-4726-9684-520e9bdd30f0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:25.014658 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b071b4dd-c75a-4726-9684-520e9bdd30f0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:25.015431 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b071b4dd-c75a-4726-9684-520e9bdd30f0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:25.015876 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b071b4dd-c75a-4726-9684-520e9bdd30f0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:25.145923 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b071b4dd-c75a-4726-9684-520e9bdd30f0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:25.153671 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b071b4dd-c75a-4726-9684-520e9bdd30f0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:25.155197 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b071b4dd-c75a-4726-9684-520e9bdd30f0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:25.156332 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b071b4dd-c75a-4726-9684-520e9bdd30f0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1745 microversion: 2.20 time: 0.154368 Jun 26 03:08:25.156881 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 265/519] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:25 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:25.821782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6db0c140-fd1d-4007-8495-b7735faba328 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:25.822359 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-6db0c140-fd1d-4007-8495-b7735faba328 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:25.824590 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:25.831124 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6db0c140-fd1d-4007-8495-b7735faba328 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:25.831573 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6db0c140-fd1d-4007-8495-b7735faba328 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:25.832327 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6db0c140-fd1d-4007-8495-b7735faba328 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:25.832761 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6db0c140-fd1d-4007-8495-b7735faba328 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:25.969186 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-6db0c140-fd1d-4007-8495-b7735faba328 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:25.977172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6db0c140-fd1d-4007-8495-b7735faba328 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1556 microversion: 2.1 time: 0.160625 Jun 26 03:08:25.977732 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 255/520] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:25 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:25.993495 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1c31c3cc-f0a1-4fb5-8043-c650e74a63be tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:25.993988 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1c31c3cc-f0a1-4fb5-8043-c650e74a63be tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:25.999883 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1c31c3cc-f0a1-4fb5-8043-c650e74a63be tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:26.000330 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1c31c3cc-f0a1-4fb5-8043-c650e74a63be tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:26.001084 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1c31c3cc-f0a1-4fb5-8043-c650e74a63be tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:26.001518 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1c31c3cc-f0a1-4fb5-8043-c650e74a63be tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:26.075402 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1c31c3cc-f0a1-4fb5-8043-c650e74a63be tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.085611 Jun 26 03:08:26.076162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 266/521] 10.222.0.13 () {58 vars in 1274 bytes} [Sun Jun 26 03:08:25 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7/os-interface => generated 284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:08:26.174788 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-633b684d-5f97-490e-940c-b9bf612db712 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:26.175545 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-633b684d-5f97-490e-940c-b9bf612db712 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:26.181519 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-633b684d-5f97-490e-940c-b9bf612db712 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:26.181970 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-633b684d-5f97-490e-940c-b9bf612db712 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:26.182767 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-633b684d-5f97-490e-940c-b9bf612db712 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:26.183266 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-633b684d-5f97-490e-940c-b9bf612db712 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:26.614933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-633b684d-5f97-490e-940c-b9bf612db712 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:26.622649 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-633b684d-5f97-490e-940c-b9bf612db712 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:26.624140 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-633b684d-5f97-490e-940c-b9bf612db712 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:26.625283 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-633b684d-5f97-490e-940c-b9bf612db712 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1740 microversion: 2.20 time: 0.454420 Jun 26 03:08:26.625831 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 256/522] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:26 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1740 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:27.273100 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-42247bd1-2248-4738-8d43-b7223467b924 req-184a3f18-e632-4f61-8690-4787fe6b602f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c4e7b87-db95-47e8-8679-3a36a89d75f7", "tag": "5b9b80b1-5c7f-45d8-944b-ab893c926663"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:08:27.281348 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-42247bd1-2248-4738-8d43-b7223467b924 req-184a3f18-e632-4f61-8690-4787fe6b602f service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:27.281876 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-42247bd1-2248-4738-8d43-b7223467b924 req-184a3f18-e632-4f61-8690-4787fe6b602f service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:27.293251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-42247bd1-2248-4738-8d43-b7223467b924 req-184a3f18-e632-4f61-8690-4787fe6b602f service nova] Creating event network-changed:5b9b80b1-5c7f-45d8-944b-ab893c926663 for instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 on hv-cinder-84684 Jun 26 03:08:27.298388 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-42247bd1-2248-4738-8d43-b7223467b924 req-184a3f18-e632-4f61-8690-4787fe6b602f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029430 Jun 26 03:08:27.298969 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 267/523] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:08:27.644597 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8eeb7119-3165-42a7-99f8-29bc58fe8611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:27.645208 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8eeb7119-3165-42a7-99f8-29bc58fe8611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:27.651727 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8eeb7119-3165-42a7-99f8-29bc58fe8611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:27.652184 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8eeb7119-3165-42a7-99f8-29bc58fe8611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:27.652946 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8eeb7119-3165-42a7-99f8-29bc58fe8611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:27.653386 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8eeb7119-3165-42a7-99f8-29bc58fe8611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:27.792971 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8eeb7119-3165-42a7-99f8-29bc58fe8611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:27.800882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8eeb7119-3165-42a7-99f8-29bc58fe8611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:27.802432 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8eeb7119-3165-42a7-99f8-29bc58fe8611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:27.803599 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8eeb7119-3165-42a7-99f8-29bc58fe8611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1740 microversion: 2.20 time: 0.163414 Jun 26 03:08:27.804159 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 257/524] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:27 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:28.822575 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ac7533e9-54e6-417e-b434-a0c853f886cd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:28.823318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ac7533e9-54e6-417e-b434-a0c853f886cd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:28.829342 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac7533e9-54e6-417e-b434-a0c853f886cd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:28.829789 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac7533e9-54e6-417e-b434-a0c853f886cd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:28.830581 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac7533e9-54e6-417e-b434-a0c853f886cd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:28.831018 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac7533e9-54e6-417e-b434-a0c853f886cd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:28.957126 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ac7533e9-54e6-417e-b434-a0c853f886cd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:28.965002 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ac7533e9-54e6-417e-b434-a0c853f886cd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:28.966545 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ac7533e9-54e6-417e-b434-a0c853f886cd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:28.967705 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ac7533e9-54e6-417e-b434-a0c853f886cd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1740 microversion: 2.20 time: 0.149831 Jun 26 03:08:28.968264 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 268/525] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:28 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:29.986388 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e8fa73f3-7746-4ad8-a3d4-0a4773a1846c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:29.987589 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e8fa73f3-7746-4ad8-a3d4-0a4773a1846c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:29.994173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e8fa73f3-7746-4ad8-a3d4-0a4773a1846c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:29.994708 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e8fa73f3-7746-4ad8-a3d4-0a4773a1846c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:29.995675 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e8fa73f3-7746-4ad8-a3d4-0a4773a1846c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:29.996345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e8fa73f3-7746-4ad8-a3d4-0a4773a1846c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:30.219857 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e8fa73f3-7746-4ad8-a3d4-0a4773a1846c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:30.228047 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e8fa73f3-7746-4ad8-a3d4-0a4773a1846c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:30.229465 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e8fa73f3-7746-4ad8-a3d4-0a4773a1846c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:30.230657 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e8fa73f3-7746-4ad8-a3d4-0a4773a1846c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1740 microversion: 2.20 time: 0.248307 Jun 26 03:08:30.231380 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 258/526] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:29 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:31.249887 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a2d88324-d1d8-4903-bb92-d5b04cb25c33 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:31.251637 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a2d88324-d1d8-4903-bb92-d5b04cb25c33 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:31.259224 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a2d88324-d1d8-4903-bb92-d5b04cb25c33 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:31.259675 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a2d88324-d1d8-4903-bb92-d5b04cb25c33 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:31.260475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a2d88324-d1d8-4903-bb92-d5b04cb25c33 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:31.260940 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a2d88324-d1d8-4903-bb92-d5b04cb25c33 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:31.411498 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a2d88324-d1d8-4903-bb92-d5b04cb25c33 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:31.420469 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a2d88324-d1d8-4903-bb92-d5b04cb25c33 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:31.422323 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a2d88324-d1d8-4903-bb92-d5b04cb25c33 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:31.423716 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a2d88324-d1d8-4903-bb92-d5b04cb25c33 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1740 microversion: 2.20 time: 0.177957 Jun 26 03:08:31.424867 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 269/527] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:31 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:32.443627 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ca629fb9-8fac-46c9-b1b6-4943e65dd0ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:32.444266 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ca629fb9-8fac-46c9-b1b6-4943e65dd0ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:32.451227 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ca629fb9-8fac-46c9-b1b6-4943e65dd0ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:32.451673 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ca629fb9-8fac-46c9-b1b6-4943e65dd0ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:32.452986 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ca629fb9-8fac-46c9-b1b6-4943e65dd0ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:32.453603 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ca629fb9-8fac-46c9-b1b6-4943e65dd0ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:32.590607 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ca629fb9-8fac-46c9-b1b6-4943e65dd0ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:32.600304 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ca629fb9-8fac-46c9-b1b6-4943e65dd0ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:32.601824 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ca629fb9-8fac-46c9-b1b6-4943e65dd0ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:32.603161 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ca629fb9-8fac-46c9-b1b6-4943e65dd0ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1740 microversion: 2.20 time: 0.164300 Jun 26 03:08:32.603899 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 259/528] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:32 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:33.622972 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d1eac6c6-e415-48d8-9df5-2f11bc9aae9a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:33.624982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d1eac6c6-e415-48d8-9df5-2f11bc9aae9a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:33.632737 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d1eac6c6-e415-48d8-9df5-2f11bc9aae9a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:33.633466 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d1eac6c6-e415-48d8-9df5-2f11bc9aae9a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:33.634336 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d1eac6c6-e415-48d8-9df5-2f11bc9aae9a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:33.635172 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d1eac6c6-e415-48d8-9df5-2f11bc9aae9a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:33.780416 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d1eac6c6-e415-48d8-9df5-2f11bc9aae9a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:33.789167 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d1eac6c6-e415-48d8-9df5-2f11bc9aae9a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:33.790728 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d1eac6c6-e415-48d8-9df5-2f11bc9aae9a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:33.791920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d1eac6c6-e415-48d8-9df5-2f11bc9aae9a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1740 microversion: 2.20 time: 0.173503 Jun 26 03:08:33.792510 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 270/529] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:33 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:08:34.296901 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ff2803de-2f31-40bd-8452-fb41f7397b73 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:34.297983 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ff2803de-2f31-40bd-8452-fb41f7397b73 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:34.305139 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ff2803de-2f31-40bd-8452-fb41f7397b73 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:34.305886 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ff2803de-2f31-40bd-8452-fb41f7397b73 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:34.306932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ff2803de-2f31-40bd-8452-fb41f7397b73 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:34.307591 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ff2803de-2f31-40bd-8452-fb41f7397b73 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:34.447303 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-ff2803de-2f31-40bd-8452-fb41f7397b73 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lazy-loading 'services' on Instance uuid 3029b3b4-985d-4a44-8afd-ec1e400fff6c {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:08:34.570231 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ff2803de-2f31-40bd-8452-fb41f7397b73 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c/os-volume_attachments/9d65f700-d7e6-4389-8f32-7f92f9c88976" status: 202 len: 0 microversion: 2.1 time: 0.277044 Jun 26 03:08:34.570838 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 260/530] 10.222.0.13 () {58 vars in 1415 bytes} [Sun Jun 26 03:08:34 2022] DELETE /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c/os-volume_attachments/9d65f700-d7e6-4389-8f32-7f92f9c88976 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:08:34.816698 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-987b2111-7516-4bfb-a27c-a5456b05a41a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:34.818953 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-987b2111-7516-4bfb-a27c-a5456b05a41a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:34.826903 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-987b2111-7516-4bfb-a27c-a5456b05a41a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:34.827635 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-987b2111-7516-4bfb-a27c-a5456b05a41a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:34.828597 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-987b2111-7516-4bfb-a27c-a5456b05a41a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:34.829465 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-987b2111-7516-4bfb-a27c-a5456b05a41a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:34.978174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-987b2111-7516-4bfb-a27c-a5456b05a41a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:34.988508 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-987b2111-7516-4bfb-a27c-a5456b05a41a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:34.990292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-987b2111-7516-4bfb-a27c-a5456b05a41a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:34.991676 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-987b2111-7516-4bfb-a27c-a5456b05a41a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1740 microversion: 2.20 time: 0.185184 Jun 26 03:08:34.992227 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 271/531] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:34 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:08:36.015261 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8a218a20-82b7-4a61-8821-3aa8affdd57a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:36.016606 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8a218a20-82b7-4a61-8821-3aa8affdd57a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:36.023471 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8a218a20-82b7-4a61-8821-3aa8affdd57a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:36.023928 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8a218a20-82b7-4a61-8821-3aa8affdd57a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:36.024720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8a218a20-82b7-4a61-8821-3aa8affdd57a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:36.025167 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8a218a20-82b7-4a61-8821-3aa8affdd57a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:36.168028 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8a218a20-82b7-4a61-8821-3aa8affdd57a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:36.177532 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8a218a20-82b7-4a61-8821-3aa8affdd57a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:36.179080 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8a218a20-82b7-4a61-8821-3aa8affdd57a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:36.180240 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8a218a20-82b7-4a61-8821-3aa8affdd57a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1740 microversion: 2.20 time: 0.172153 Jun 26 03:08:36.181827 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 261/532] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:36 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:36.778238 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b7ced852-2864-4f57-aa73-0f7cd47ca583 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:36.779324 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b7ced852-2864-4f57-aa73-0f7cd47ca583 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:36.781969 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=66 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:36.788602 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b7ced852-2864-4f57-aa73-0f7cd47ca583 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:36.789067 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b7ced852-2864-4f57-aa73-0f7cd47ca583 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:36.790070 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b7ced852-2864-4f57-aa73-0f7cd47ca583 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:36.790512 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b7ced852-2864-4f57-aa73-0f7cd47ca583 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:36.815735 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b7ced852-2864-4f57-aa73-0f7cd47ca583 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:08:36.897218 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b7ced852-2864-4f57-aa73-0f7cd47ca583 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 204 len: 0 microversion: 2.1 time: 0.123265 Jun 26 03:08:36.898262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 272/533] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:08:36 2022] DELETE /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:08:36.906893 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-0353733e-9708-4afd-8701-4ad5eed0c60a tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:36.907526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-0353733e-9708-4afd-8701-4ad5eed0c60a tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:36.913657 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0353733e-9708-4afd-8701-4ad5eed0c60a tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:36.914149 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0353733e-9708-4afd-8701-4ad5eed0c60a tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:36.914948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0353733e-9708-4afd-8701-4ad5eed0c60a tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:36.915386 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0353733e-9708-4afd-8701-4ad5eed0c60a tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:37.056463 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-0353733e-9708-4afd-8701-4ad5eed0c60a tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:37.065500 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-0353733e-9708-4afd-8701-4ad5eed0c60a tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1512 microversion: 2.1 time: 0.163119 Jun 26 03:08:37.066082 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 262/534] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:36 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:08:37.200135 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6eaf81a7-0f8b-4d79-a3a1-cacc93d2ef7a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:37.201044 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-6eaf81a7-0f8b-4d79-a3a1-cacc93d2ef7a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:37.207743 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6eaf81a7-0f8b-4d79-a3a1-cacc93d2ef7a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:37.208210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6eaf81a7-0f8b-4d79-a3a1-cacc93d2ef7a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:37.208998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6eaf81a7-0f8b-4d79-a3a1-cacc93d2ef7a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:37.209452 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6eaf81a7-0f8b-4d79-a3a1-cacc93d2ef7a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:37.349097 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6eaf81a7-0f8b-4d79-a3a1-cacc93d2ef7a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:37.357400 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6eaf81a7-0f8b-4d79-a3a1-cacc93d2ef7a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:37.359073 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6eaf81a7-0f8b-4d79-a3a1-cacc93d2ef7a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:37.360558 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6eaf81a7-0f8b-4d79-a3a1-cacc93d2ef7a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1740 microversion: 2.20 time: 0.164466 Jun 26 03:08:37.361161 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 273/535] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:37 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:08:38.083867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8b48d193-f6ad-4c28-95b5-d58432c09496 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:38.085148 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8b48d193-f6ad-4c28-95b5-d58432c09496 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:38.092290 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8b48d193-f6ad-4c28-95b5-d58432c09496 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:38.092744 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8b48d193-f6ad-4c28-95b5-d58432c09496 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:38.093509 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8b48d193-f6ad-4c28-95b5-d58432c09496 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:38.094004 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8b48d193-f6ad-4c28-95b5-d58432c09496 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:38.232660 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8b48d193-f6ad-4c28-95b5-d58432c09496 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:38.241240 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8b48d193-f6ad-4c28-95b5-d58432c09496 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1512 microversion: 2.1 time: 0.161920 Jun 26 03:08:38.241806 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 263/536] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:38 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:38.379890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c8eb2005-3b54-447e-89ff-7ba73f99b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:38.380513 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c8eb2005-3b54-447e-89ff-7ba73f99b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:38.387178 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c8eb2005-3b54-447e-89ff-7ba73f99b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:38.387817 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c8eb2005-3b54-447e-89ff-7ba73f99b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:38.388582 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c8eb2005-3b54-447e-89ff-7ba73f99b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:38.389017 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c8eb2005-3b54-447e-89ff-7ba73f99b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:38.526900 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c8eb2005-3b54-447e-89ff-7ba73f99b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:38.535460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c8eb2005-3b54-447e-89ff-7ba73f99b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:38.536991 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c8eb2005-3b54-447e-89ff-7ba73f99b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:38.538233 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c8eb2005-3b54-447e-89ff-7ba73f99b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1740 microversion: 2.20 time: 0.163257 Jun 26 03:08:38.538800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 274/537] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:38 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:39.259702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a8befd52-495d-429e-b7fd-360cba03a9b5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:39.260321 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a8befd52-495d-429e-b7fd-360cba03a9b5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:39.267703 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a8befd52-495d-429e-b7fd-360cba03a9b5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:39.268155 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a8befd52-495d-429e-b7fd-360cba03a9b5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:39.268939 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a8befd52-495d-429e-b7fd-360cba03a9b5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:39.269378 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a8befd52-495d-429e-b7fd-360cba03a9b5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:39.412080 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a8befd52-495d-429e-b7fd-360cba03a9b5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:39.420176 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a8befd52-495d-429e-b7fd-360cba03a9b5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1512 microversion: 2.1 time: 0.164440 Jun 26 03:08:39.420970 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 264/538] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:39 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:39.558994 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-48daf61e-a402-4c2b-8c7c-bf60a61b7284 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:39.561026 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-48daf61e-a402-4c2b-8c7c-bf60a61b7284 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:39.570858 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-48daf61e-a402-4c2b-8c7c-bf60a61b7284 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:39.571671 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-48daf61e-a402-4c2b-8c7c-bf60a61b7284 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:39.572834 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-48daf61e-a402-4c2b-8c7c-bf60a61b7284 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:39.574336 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-48daf61e-a402-4c2b-8c7c-bf60a61b7284 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:39.900489 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-48daf61e-a402-4c2b-8c7c-bf60a61b7284 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:39.903327 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:39.916170 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-48daf61e-a402-4c2b-8c7c-bf60a61b7284 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:39.917706 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-48daf61e-a402-4c2b-8c7c-bf60a61b7284 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:39.919238 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-48daf61e-a402-4c2b-8c7c-bf60a61b7284 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1740 microversion: 2.20 time: 0.365410 Jun 26 03:08:39.930906 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 275/539] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:39 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1740 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:40.264082 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-5d74caf4-220e-4ee1-acd8-dd63976455a4 req-504c80d9-e540-4c9d-b270-135b23b0cc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3029b3b4-985d-4a44-8afd-ec1e400fff6c", "name": "network-vif-deleted", "tag": "769a529d-21f4-483c-a2a1-bd0854c06dc4"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:08:40.273631 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-5d74caf4-220e-4ee1-acd8-dd63976455a4 req-504c80d9-e540-4c9d-b270-135b23b0cc4d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:40.274103 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-5d74caf4-220e-4ee1-acd8-dd63976455a4 req-504c80d9-e540-4c9d-b270-135b23b0cc4d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:40.284887 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-5d74caf4-220e-4ee1-acd8-dd63976455a4 req-504c80d9-e540-4c9d-b270-135b23b0cc4d service nova] Creating event network-vif-deleted:769a529d-21f4-483c-a2a1-bd0854c06dc4 for instance 3029b3b4-985d-4a44-8afd-ec1e400fff6c on hv-cinder-84684 Jun 26 03:08:40.289799 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-5d74caf4-220e-4ee1-acd8-dd63976455a4 req-504c80d9-e540-4c9d-b270-135b23b0cc4d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029850 Jun 26 03:08:40.290426 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 265/540] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:08:40.439299 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-28d6a109-3d72-4318-b179-77e05a3d57ff tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:40.439824 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-28d6a109-3d72-4318-b179-77e05a3d57ff tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:40.447800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-28d6a109-3d72-4318-b179-77e05a3d57ff tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:40.448373 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-28d6a109-3d72-4318-b179-77e05a3d57ff tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:40.449141 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-28d6a109-3d72-4318-b179-77e05a3d57ff tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:40.449574 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-28d6a109-3d72-4318-b179-77e05a3d57ff tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:40.480074 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-28d6a109-3d72-4318-b179-77e05a3d57ff tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:40.480526 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-28d6a109-3d72-4318-b179-77e05a3d57ff tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:40.480989 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.objects.instance [None req-28d6a109-3d72-4318-b179-77e05a3d57ff tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lazy-loading 'fault' on Instance uuid 3029b3b4-985d-4a44-8afd-ec1e400fff6c {{(pid=117783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:08:40.528041 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-28d6a109-3d72-4318-b179-77e05a3d57ff tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:40.535497 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-28d6a109-3d72-4318-b179-77e05a3d57ff tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1307 microversion: 2.1 time: 0.101239 Jun 26 03:08:40.536053 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 276/541] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:40 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:08:40.937777 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7796bb6a-c524-4e41-bc21-b9d72fd6f944 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:40.938500 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7796bb6a-c524-4e41-bc21-b9d72fd6f944 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:40.944622 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7796bb6a-c524-4e41-bc21-b9d72fd6f944 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:40.945074 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7796bb6a-c524-4e41-bc21-b9d72fd6f944 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:40.945902 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7796bb6a-c524-4e41-bc21-b9d72fd6f944 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:40.946305 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7796bb6a-c524-4e41-bc21-b9d72fd6f944 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:41.071790 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7796bb6a-c524-4e41-bc21-b9d72fd6f944 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:41.079531 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7796bb6a-c524-4e41-bc21-b9d72fd6f944 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:41.081519 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7796bb6a-c524-4e41-bc21-b9d72fd6f944 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:41.082719 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-7796bb6a-c524-4e41-bc21-b9d72fd6f944 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1740 microversion: 2.20 time: 0.149134 Jun 26 03:08:41.083267 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 266/542] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:40 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1740 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:41.553412 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-43339cae-0109-4f52-a178-7ee8ab1f6602 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:41.554021 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-43339cae-0109-4f52-a178-7ee8ab1f6602 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:41.560802 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-43339cae-0109-4f52-a178-7ee8ab1f6602 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:41.561305 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-43339cae-0109-4f52-a178-7ee8ab1f6602 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:41.562141 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-43339cae-0109-4f52-a178-7ee8ab1f6602 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:41.562524 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-43339cae-0109-4f52-a178-7ee8ab1f6602 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:41.592355 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-43339cae-0109-4f52-a178-7ee8ab1f6602 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:41.592807 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-43339cae-0109-4f52-a178-7ee8ab1f6602 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:41.593493 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.objects.instance [None req-43339cae-0109-4f52-a178-7ee8ab1f6602 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lazy-loading 'fault' on Instance uuid 3029b3b4-985d-4a44-8afd-ec1e400fff6c {{(pid=117783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:08:41.647096 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-43339cae-0109-4f52-a178-7ee8ab1f6602 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:41.655166 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-43339cae-0109-4f52-a178-7ee8ab1f6602 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 200 len: 1307 microversion: 2.1 time: 0.106372 Jun 26 03:08:41.655777 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 277/543] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:41 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:42.101352 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-00117767-9e7f-4893-9c6b-9d0d54abe0bf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:42.102005 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-00117767-9e7f-4893-9c6b-9d0d54abe0bf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:42.108355 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-00117767-9e7f-4893-9c6b-9d0d54abe0bf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:42.108801 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-00117767-9e7f-4893-9c6b-9d0d54abe0bf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:42.109557 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-00117767-9e7f-4893-9c6b-9d0d54abe0bf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:42.109992 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-00117767-9e7f-4893-9c6b-9d0d54abe0bf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:42.319921 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-00117767-9e7f-4893-9c6b-9d0d54abe0bf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:42.327748 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-00117767-9e7f-4893-9c6b-9d0d54abe0bf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:42.329244 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-00117767-9e7f-4893-9c6b-9d0d54abe0bf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:42.330419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-00117767-9e7f-4893-9c6b-9d0d54abe0bf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1722 microversion: 2.20 time: 0.233565 Jun 26 03:08:42.331521 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 267/544] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:42 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:42.672799 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-37b5c86b-42dc-4209-96a0-4c81cdd0e9f8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:42.673411 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-37b5c86b-42dc-4209-96a0-4c81cdd0e9f8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: 3029b3b4-985d-4a44-8afd-ec1e400fff6c] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:42.680386 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-37b5c86b-42dc-4209-96a0-4c81cdd0e9f8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:42.680781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-37b5c86b-42dc-4209-96a0-4c81cdd0e9f8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:42.681563 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-37b5c86b-42dc-4209-96a0-4c81cdd0e9f8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:42.682007 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-37b5c86b-42dc-4209-96a0-4c81cdd0e9f8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:42.695829 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-37b5c86b-42dc-4209-96a0-4c81cdd0e9f8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] HTTP exception thrown: Instance 3029b3b4-985d-4a44-8afd-ec1e400fff6c could not be found. Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-37b5c86b-42dc-4209-96a0-4c81cdd0e9f8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Request method failure captured: Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c HTTP/1.1 Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit81nuJ4DSXAgQdEbrfpRCZ6LNZHgpUNChCPFyRyOumuW0KGe31kE00suoN-gYwFs99_jEyeWR5rQuTWbkeBXCBFr2VUx_zz9TE1E_Szx9VS-E3nM8g1KdFz50qP4AzmlGdpXW6ea6sfsqMwL1oD3Qbar4VuCX62AUB4DtXnqBKiy_9I Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: f93abb7628324906baa8d45ce8d1a153 Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1670411537 Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:08:42.697446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:08:42.698978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f93abb7628324906baa8d45ce8d1a153"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f93abb7628324906baa8d45ce8d1a153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f93abb7628324906baa8d45ce8d1a153"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f93abb7628324906baa8d45ce8d1a153"}]}] Jun 26 03:08:42.698978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-VolumesSnapshotTestJSON-1670411537 Jun 26 03:08:42.698978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: f93abb7628324906baa8d45ce8d1a153 Jun 26 03:08:42.698978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1670411537 Jun 26 03:08:42.698978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-VolumesSnapshotTestJSON-1670411537-project Jun 26 03:08:42.698978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:08:42.698978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:08:42.698978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 497fd3327d1441c8b3933bda95f673af Jun 26 03:08:42.698978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-VolumesSnapshotTestJSON-1670411537-project Jun 26 03:08:42.698978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:08:42.698978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 3029b3b4-985d-4a44-8afd-ec1e400fff6c could not be found. Jun 26 03:08:42.698978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '3029b3b4-985d-4a44-8afd-ec1e400fff6c'} Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3029b3b4-985d-4a44-8afd-ec1e400fff6c could not be found. Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:08:42.699842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3029b3b4-985d-4a44-8afd-ec1e400fff6c could not be found. Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3029b3b4-985d-4a44-8afd-ec1e400fff6c could not be found. Jun 26 03:08:42.701111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:08:42.702171 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-37b5c86b-42dc-4209-96a0-4c81cdd0e9f8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Returning 404 to user: Instance 3029b3b4-985d-4a44-8afd-ec1e400fff6c could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:08:42.702171 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-37b5c86b-42dc-4209-96a0-4c81cdd0e9f8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c" status: 404 len: 111 microversion: 2.1 time: 0.029952 Jun 26 03:08:42.702171 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 278/545] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:42 2022] GET /compute/v2.1/servers/3029b3b4-985d-4a44-8afd-ec1e400fff6c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:08:43.349173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d4c7c86d-3297-4f28-8268-94338b9620ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:43.349779 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d4c7c86d-3297-4f28-8268-94338b9620ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:43.356208 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4c7c86d-3297-4f28-8268-94338b9620ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:43.356656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4c7c86d-3297-4f28-8268-94338b9620ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:43.357411 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4c7c86d-3297-4f28-8268-94338b9620ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:43.357847 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4c7c86d-3297-4f28-8268-94338b9620ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:43.485637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d4c7c86d-3297-4f28-8268-94338b9620ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:43.493792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d4c7c86d-3297-4f28-8268-94338b9620ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:43.495319 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d4c7c86d-3297-4f28-8268-94338b9620ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:43.496454 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d4c7c86d-3297-4f28-8268-94338b9620ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1722 microversion: 2.20 time: 0.151161 Jun 26 03:08:43.497039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 268/546] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:43 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:44.515102 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e74d2981-d0a3-4395-a805-d5487d8a9b8f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:44.515715 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e74d2981-d0a3-4395-a805-d5487d8a9b8f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:44.522231 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e74d2981-d0a3-4395-a805-d5487d8a9b8f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:44.522690 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e74d2981-d0a3-4395-a805-d5487d8a9b8f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:44.523452 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e74d2981-d0a3-4395-a805-d5487d8a9b8f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:44.523893 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e74d2981-d0a3-4395-a805-d5487d8a9b8f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:44.655299 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e74d2981-d0a3-4395-a805-d5487d8a9b8f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:44.663654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e74d2981-d0a3-4395-a805-d5487d8a9b8f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:44.665171 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e74d2981-d0a3-4395-a805-d5487d8a9b8f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:44.666349 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e74d2981-d0a3-4395-a805-d5487d8a9b8f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1722 microversion: 2.20 time: 0.155121 Jun 26 03:08:44.666907 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 279/547] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:44 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:45.686398 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e7ba3644-f694-4cd7-a7cf-c74531c2149c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:45.687004 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e7ba3644-f694-4cd7-a7cf-c74531c2149c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:45.693613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e7ba3644-f694-4cd7-a7cf-c74531c2149c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:45.694082 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e7ba3644-f694-4cd7-a7cf-c74531c2149c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:45.694851 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e7ba3644-f694-4cd7-a7cf-c74531c2149c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:45.695289 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e7ba3644-f694-4cd7-a7cf-c74531c2149c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:45.822101 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e7ba3644-f694-4cd7-a7cf-c74531c2149c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:45.832490 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e7ba3644-f694-4cd7-a7cf-c74531c2149c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:45.833981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e7ba3644-f694-4cd7-a7cf-c74531c2149c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:45.835142 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e7ba3644-f694-4cd7-a7cf-c74531c2149c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1722 microversion: 2.20 time: 0.153660 Jun 26 03:08:45.835691 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 269/548] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:45 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:46.853148 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ff7d43fb-ccb7-4fe4-9395-010baeb3505f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:46.854218 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ff7d43fb-ccb7-4fe4-9395-010baeb3505f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:46.860639 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ff7d43fb-ccb7-4fe4-9395-010baeb3505f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:46.861164 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ff7d43fb-ccb7-4fe4-9395-010baeb3505f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:46.861999 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ff7d43fb-ccb7-4fe4-9395-010baeb3505f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:46.862478 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ff7d43fb-ccb7-4fe4-9395-010baeb3505f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:46.928004 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-43a0e429-e1c9-4617-8485-9d1b2efa2d97 req-18e3fb5b-f2f4-4bf1-ba62-bc6789071200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0d1d9b-d025-442c-a2f6-db22050d9059", "name": "network-vif-unplugged", "status": "completed", "tag": "52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:08:46.938525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-43a0e429-e1c9-4617-8485-9d1b2efa2d97 req-18e3fb5b-f2f4-4bf1-ba62-bc6789071200 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:46.939061 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-43a0e429-e1c9-4617-8485-9d1b2efa2d97 req-18e3fb5b-f2f4-4bf1-ba62-bc6789071200 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:46.951405 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-43a0e429-e1c9-4617-8485-9d1b2efa2d97 req-18e3fb5b-f2f4-4bf1-ba62-bc6789071200 service nova] Creating event network-vif-unplugged:52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f for instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 on hv-cinder-84684 Jun 26 03:08:46.958480 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-43a0e429-e1c9-4617-8485-9d1b2efa2d97 req-18e3fb5b-f2f4-4bf1-ba62-bc6789071200 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034053 Jun 26 03:08:46.959865 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 270/549] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:08:47.005898 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ff7d43fb-ccb7-4fe4-9395-010baeb3505f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:47.014160 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ff7d43fb-ccb7-4fe4-9395-010baeb3505f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:47.015657 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ff7d43fb-ccb7-4fe4-9395-010baeb3505f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:47.016799 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ff7d43fb-ccb7-4fe4-9395-010baeb3505f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1722 microversion: 2.20 time: 0.167578 Jun 26 03:08:47.017350 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 280/550] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:46 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:48.037008 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-688d9995-6525-438f-a483-a11720443f86 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:48.037714 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-688d9995-6525-438f-a483-a11720443f86 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:48.044008 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-688d9995-6525-438f-a483-a11720443f86 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:48.044462 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-688d9995-6525-438f-a483-a11720443f86 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:48.045362 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-688d9995-6525-438f-a483-a11720443f86 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:48.045663 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-688d9995-6525-438f-a483-a11720443f86 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:48.197005 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-688d9995-6525-438f-a483-a11720443f86 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:48.204964 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-688d9995-6525-438f-a483-a11720443f86 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:48.207076 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-688d9995-6525-438f-a483-a11720443f86 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:48.208233 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-688d9995-6525-438f-a483-a11720443f86 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1725 microversion: 2.20 time: 0.176615 Jun 26 03:08:48.208792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 271/551] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:48 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:48.226264 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4b21f0d6-be34-4217-b98a-49d6f65c8e95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc221f1c-1250-42d1-aea8-3cf7c40bc0c0"}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:08:48.227321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4b21f0d6-be34-4217-b98a-49d6f65c8e95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:48.233711 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4b21f0d6-be34-4217-b98a-49d6f65c8e95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:48.234220 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4b21f0d6-be34-4217-b98a-49d6f65c8e95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:48.234975 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4b21f0d6-be34-4217-b98a-49d6f65c8e95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:48.235410 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4b21f0d6-be34-4217-b98a-49d6f65c8e95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:48.511343 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4b21f0d6-be34-4217-b98a-49d6f65c8e95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "POST /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289179 Jun 26 03:08:48.512117 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 281/552] 10.222.0.13 () {62 vars in 1363 bytes} [Sun Jun 26 03:08:48 2022] POST /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 26 03:08:48.631106 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9ff8f6ef-88f0-4e15-964a-285dc8d1c78f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:08:48.631667 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9ff8f6ef-88f0-4e15-964a-285dc8d1c78f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:48.637487 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ff8f6ef-88f0-4e15-964a-285dc8d1c78f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:48.637930 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ff8f6ef-88f0-4e15-964a-285dc8d1c78f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:48.638711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ff8f6ef-88f0-4e15-964a-285dc8d1c78f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:48.639146 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ff8f6ef-88f0-4e15-964a-285dc8d1c78f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:48.642796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:48.726439 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9ff8f6ef-88f0-4e15-964a-285dc8d1c78f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "POST /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/action" status: 202 len: 0 microversion: 2.20 time: 0.100132 Jun 26 03:08:48.727045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 272/553] 10.222.0.13 () {62 vars in 1318 bytes} [Sun Jun 26 03:08:48 2022] POST /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:08:48.735275 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b707ed87-b5f8-421d-a979-3b42c964254d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:48.735880 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b707ed87-b5f8-421d-a979-3b42c964254d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:48.742893 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b707ed87-b5f8-421d-a979-3b42c964254d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:48.743344 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b707ed87-b5f8-421d-a979-3b42c964254d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:48.744104 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b707ed87-b5f8-421d-a979-3b42c964254d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:48.744541 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b707ed87-b5f8-421d-a979-3b42c964254d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:48.882170 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b707ed87-b5f8-421d-a979-3b42c964254d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:48.890647 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b707ed87-b5f8-421d-a979-3b42c964254d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:48.892158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b707ed87-b5f8-421d-a979-3b42c964254d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:48.893345 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b707ed87-b5f8-421d-a979-3b42c964254d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1751 microversion: 2.20 time: 0.161951 Jun 26 03:08:48.894080 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 282/554] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:48 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:08:49.911936 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4c398a31-3dfc-455d-b156-377727da2ace tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:49.912543 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4c398a31-3dfc-455d-b156-377727da2ace tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:49.918495 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4c398a31-3dfc-455d-b156-377727da2ace tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:49.918950 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4c398a31-3dfc-455d-b156-377727da2ace tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:49.919708 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4c398a31-3dfc-455d-b156-377727da2ace tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:49.920150 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4c398a31-3dfc-455d-b156-377727da2ace tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:50.046331 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4c398a31-3dfc-455d-b156-377727da2ace tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:50.056151 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4c398a31-3dfc-455d-b156-377727da2ace tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:50.057667 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4c398a31-3dfc-455d-b156-377727da2ace tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:50.058865 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4c398a31-3dfc-455d-b156-377727da2ace tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1751 microversion: 2.20 time: 0.151337 Jun 26 03:08:50.059466 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 273/555] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:49 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:51.078224 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9dce0d8f-fb21-415d-823e-c254f87ace70 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:51.078838 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9dce0d8f-fb21-415d-823e-c254f87ace70 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:51.085759 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9dce0d8f-fb21-415d-823e-c254f87ace70 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:51.086250 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9dce0d8f-fb21-415d-823e-c254f87ace70 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:51.087012 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9dce0d8f-fb21-415d-823e-c254f87ace70 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:51.087465 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9dce0d8f-fb21-415d-823e-c254f87ace70 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:51.214793 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9dce0d8f-fb21-415d-823e-c254f87ace70 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:51.223055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9dce0d8f-fb21-415d-823e-c254f87ace70 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:51.224555 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9dce0d8f-fb21-415d-823e-c254f87ace70 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:51.225703 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9dce0d8f-fb21-415d-823e-c254f87ace70 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1753 microversion: 2.20 time: 0.151399 Jun 26 03:08:51.226294 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 283/556] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:51 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:52.244183 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-30107136-e2cd-4262-b96b-b2078dff0e9b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:52.244793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-30107136-e2cd-4262-b96b-b2078dff0e9b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:52.251234 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-30107136-e2cd-4262-b96b-b2078dff0e9b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:52.251680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-30107136-e2cd-4262-b96b-b2078dff0e9b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:52.252436 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-30107136-e2cd-4262-b96b-b2078dff0e9b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:52.252874 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-30107136-e2cd-4262-b96b-b2078dff0e9b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:52.381631 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-30107136-e2cd-4262-b96b-b2078dff0e9b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:52.389938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-30107136-e2cd-4262-b96b-b2078dff0e9b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:52.391458 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-30107136-e2cd-4262-b96b-b2078dff0e9b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:52.392602 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-30107136-e2cd-4262-b96b-b2078dff0e9b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1753 microversion: 2.20 time: 0.152312 Jun 26 03:08:52.393657 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 274/557] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:52 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:53.411217 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4528f90f-7fa4-4a38-9850-44d124b04566 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:53.411820 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4528f90f-7fa4-4a38-9850-44d124b04566 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:53.418300 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4528f90f-7fa4-4a38-9850-44d124b04566 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:53.418756 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4528f90f-7fa4-4a38-9850-44d124b04566 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:53.419518 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4528f90f-7fa4-4a38-9850-44d124b04566 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:53.419961 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4528f90f-7fa4-4a38-9850-44d124b04566 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:53.548211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4528f90f-7fa4-4a38-9850-44d124b04566 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:53.557360 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4528f90f-7fa4-4a38-9850-44d124b04566 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:53.558878 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4528f90f-7fa4-4a38-9850-44d124b04566 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:53.560020 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4528f90f-7fa4-4a38-9850-44d124b04566 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1753 microversion: 2.20 time: 0.152728 Jun 26 03:08:53.560569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 284/558] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:53 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:54.578237 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ab7fdf68-975c-49bc-a0eb-1496ceb12a04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:54.578848 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ab7fdf68-975c-49bc-a0eb-1496ceb12a04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:54.579908 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1568814588", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "networks": [{"uuid": "23f3dc3b-096d-4bd7-ac08-420e217fa87e"}]}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:08:54.585127 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ab7fdf68-975c-49bc-a0eb-1496ceb12a04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:54.585597 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ab7fdf68-975c-49bc-a0eb-1496ceb12a04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:54.586411 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ab7fdf68-975c-49bc-a0eb-1496ceb12a04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:54.586855 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ab7fdf68-975c-49bc-a0eb-1496ceb12a04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:54.640079 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] validate_networks() for [('23f3dc3b-096d-4bd7-ac08-420e217fa87e', None, None, None, None, None)] {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:08:54.800324 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ab7fdf68-975c-49bc-a0eb-1496ceb12a04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:54.808838 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ab7fdf68-975c-49bc-a0eb-1496ceb12a04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:54.810392 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ab7fdf68-975c-49bc-a0eb-1496ceb12a04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:54.811548 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ab7fdf68-975c-49bc-a0eb-1496ceb12a04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1753 microversion: 2.20 time: 0.237170 Jun 26 03:08:54.812107 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 275/559] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:54 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1753 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:55.103693 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:08:55.104126 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:08:55.104647 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:08:55.105089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:08:55.105504 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:08:55.115063 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:55.115501 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:55.116291 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:55.116727 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:55.134251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Getting quotas for project f93abb7628324906baa8d45ce8d1a153. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:08:55.138273 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Getting quotas for user 497fd3327d1441c8b3933bda95f673af and project f93abb7628324906baa8d45ce8d1a153. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:08:55.149050 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:08:55.151350 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:08:55.196887 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ef862fe0-5c45-4c95-89bc-fa3980dc5443 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620684 Jun 26 03:08:55.197521 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 285/560] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:08:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 26 03:08:55.207552 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-36421d65-aaf9-4189-bdb3-29e9e3c13bc5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:55.208407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-36421d65-aaf9-4189-bdb3-29e9e3c13bc5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:55.288033 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-36421d65-aaf9-4189-bdb3-29e9e3c13bc5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:55.295674 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-36421d65-aaf9-4189-bdb3-29e9e3c13bc5 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1219 microversion: 2.1 time: 0.092236 Jun 26 03:08:55.296253 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 276/561] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:55 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:55.831254 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9bd5f8ab-2f5b-4eec-a24e-678b7109d659 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:55.831872 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9bd5f8ab-2f5b-4eec-a24e-678b7109d659 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:55.838816 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9bd5f8ab-2f5b-4eec-a24e-678b7109d659 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:55.839276 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9bd5f8ab-2f5b-4eec-a24e-678b7109d659 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:55.840048 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9bd5f8ab-2f5b-4eec-a24e-678b7109d659 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:55.840493 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9bd5f8ab-2f5b-4eec-a24e-678b7109d659 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:55.987603 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9bd5f8ab-2f5b-4eec-a24e-678b7109d659 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:55.996092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9bd5f8ab-2f5b-4eec-a24e-678b7109d659 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:55.997693 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9bd5f8ab-2f5b-4eec-a24e-678b7109d659 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:55.998962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9bd5f8ab-2f5b-4eec-a24e-678b7109d659 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.172697 Jun 26 03:08:55.999779 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 286/562] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:55 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:56.314517 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d50ab826-b55f-459d-9649-de894ff54148 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:56.315694 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d50ab826-b55f-459d-9649-de894ff54148 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:56.317834 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=48 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:56.324811 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d50ab826-b55f-459d-9649-de894ff54148 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:56.325329 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d50ab826-b55f-459d-9649-de894ff54148 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:56.326369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d50ab826-b55f-459d-9649-de894ff54148 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:56.326811 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d50ab826-b55f-459d-9649-de894ff54148 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:56.389677 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d50ab826-b55f-459d-9649-de894ff54148 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:56.397247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d50ab826-b55f-459d-9649-de894ff54148 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.086599 Jun 26 03:08:56.397812 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 277/563] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:56 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:57.019502 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-75483cbf-bcb9-440a-95c7-1703ecad889e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:57.020113 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-75483cbf-bcb9-440a-95c7-1703ecad889e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:57.026659 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-75483cbf-bcb9-440a-95c7-1703ecad889e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:57.027113 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-75483cbf-bcb9-440a-95c7-1703ecad889e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:57.027869 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-75483cbf-bcb9-440a-95c7-1703ecad889e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:57.028309 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-75483cbf-bcb9-440a-95c7-1703ecad889e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:57.163391 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-75483cbf-bcb9-440a-95c7-1703ecad889e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:57.172539 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-75483cbf-bcb9-440a-95c7-1703ecad889e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:57.174119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-75483cbf-bcb9-440a-95c7-1703ecad889e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:57.175917 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-75483cbf-bcb9-440a-95c7-1703ecad889e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.160312 Jun 26 03:08:57.176479 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 287/564] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:57 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:57.414976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fe76c3ce-b5a9-4aae-a4a2-1a3ecaa0fb65 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:57.415586 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-fe76c3ce-b5a9-4aae-a4a2-1a3ecaa0fb65 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:57.422118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fe76c3ce-b5a9-4aae-a4a2-1a3ecaa0fb65 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:57.422581 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fe76c3ce-b5a9-4aae-a4a2-1a3ecaa0fb65 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:57.423340 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fe76c3ce-b5a9-4aae-a4a2-1a3ecaa0fb65 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:57.423812 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fe76c3ce-b5a9-4aae-a4a2-1a3ecaa0fb65 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:57.486340 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-fe76c3ce-b5a9-4aae-a4a2-1a3ecaa0fb65 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:57.494188 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-fe76c3ce-b5a9-4aae-a4a2-1a3ecaa0fb65 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.083063 Jun 26 03:08:57.494743 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 278/565] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:57 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:58.194233 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4e104bb9-dea5-4fb2-bb89-3b249a3fe20c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:58.194837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4e104bb9-dea5-4fb2-bb89-3b249a3fe20c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:58.201328 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4e104bb9-dea5-4fb2-bb89-3b249a3fe20c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:58.201791 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4e104bb9-dea5-4fb2-bb89-3b249a3fe20c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:58.202570 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4e104bb9-dea5-4fb2-bb89-3b249a3fe20c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:58.203005 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4e104bb9-dea5-4fb2-bb89-3b249a3fe20c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:58.335924 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4e104bb9-dea5-4fb2-bb89-3b249a3fe20c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:58.344994 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4e104bb9-dea5-4fb2-bb89-3b249a3fe20c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:58.346513 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4e104bb9-dea5-4fb2-bb89-3b249a3fe20c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:58.347667 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4e104bb9-dea5-4fb2-bb89-3b249a3fe20c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.157825 Jun 26 03:08:58.348424 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 288/566] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:58 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:08:58.510906 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8eddceb1-911a-4061-a7af-23a92561228d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:58.511515 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8eddceb1-911a-4061-a7af-23a92561228d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:58.517953 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8eddceb1-911a-4061-a7af-23a92561228d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:58.518439 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8eddceb1-911a-4061-a7af-23a92561228d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:58.519198 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8eddceb1-911a-4061-a7af-23a92561228d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:58.519640 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8eddceb1-911a-4061-a7af-23a92561228d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:58.579094 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8eddceb1-911a-4061-a7af-23a92561228d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:58.586353 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8eddceb1-911a-4061-a7af-23a92561228d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.079256 Jun 26 03:08:58.586918 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 279/567] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:58 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:08:59.365524 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-cdea49cd-02c1-43ac-9050-419d84b3510f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:59.366269 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-cdea49cd-02c1-43ac-9050-419d84b3510f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:59.372814 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cdea49cd-02c1-43ac-9050-419d84b3510f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:59.373267 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cdea49cd-02c1-43ac-9050-419d84b3510f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:59.374065 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cdea49cd-02c1-43ac-9050-419d84b3510f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:59.374512 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cdea49cd-02c1-43ac-9050-419d84b3510f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:59.514151 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-cdea49cd-02c1-43ac-9050-419d84b3510f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:59.523057 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-cdea49cd-02c1-43ac-9050-419d84b3510f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:59.524548 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-cdea49cd-02c1-43ac-9050-419d84b3510f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:59.525697 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-cdea49cd-02c1-43ac-9050-419d84b3510f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.164031 Jun 26 03:08:59.526273 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 289/568] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:08:59 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:08:59.603013 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-57a1f9d4-1cc4-4bf5-8de2-0af945ba121f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:08:59.603632 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-57a1f9d4-1cc4-4bf5-8de2-0af945ba121f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:08:59.610074 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-57a1f9d4-1cc4-4bf5-8de2-0af945ba121f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:59.610536 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-57a1f9d4-1cc4-4bf5-8de2-0af945ba121f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:59.611304 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-57a1f9d4-1cc4-4bf5-8de2-0af945ba121f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:08:59.611747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-57a1f9d4-1cc4-4bf5-8de2-0af945ba121f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:08:59.672772 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-57a1f9d4-1cc4-4bf5-8de2-0af945ba121f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:08:59.680334 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-57a1f9d4-1cc4-4bf5-8de2-0af945ba121f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.081125 Jun 26 03:08:59.680907 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 280/569] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:08:59 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:00.544079 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-83523d14-8d0c-4da9-9653-070d1382b8c7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:00.544676 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-83523d14-8d0c-4da9-9653-070d1382b8c7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:00.551460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-83523d14-8d0c-4da9-9653-070d1382b8c7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:00.551920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-83523d14-8d0c-4da9-9653-070d1382b8c7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:00.552711 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-83523d14-8d0c-4da9-9653-070d1382b8c7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:00.553145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-83523d14-8d0c-4da9-9653-070d1382b8c7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:00.568530 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:00.692190 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-83523d14-8d0c-4da9-9653-070d1382b8c7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:00.698247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fe62a5b1-3e18-498f-bc03-a5193c0b50aa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:00.699136 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-fe62a5b1-3e18-498f-bc03-a5193c0b50aa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:00.701323 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-83523d14-8d0c-4da9-9653-070d1382b8c7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:00.702881 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-83523d14-8d0c-4da9-9653-070d1382b8c7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:00.704069 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-83523d14-8d0c-4da9-9653-070d1382b8c7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.164037 Jun 26 03:09:00.704806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 290/570] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:00 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:00.709296 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fe62a5b1-3e18-498f-bc03-a5193c0b50aa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:00.709676 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fe62a5b1-3e18-498f-bc03-a5193c0b50aa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:00.710472 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fe62a5b1-3e18-498f-bc03-a5193c0b50aa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:00.710910 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fe62a5b1-3e18-498f-bc03-a5193c0b50aa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:00.779817 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-fe62a5b1-3e18-498f-bc03-a5193c0b50aa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:00.788243 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-fe62a5b1-3e18-498f-bc03-a5193c0b50aa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.094510 Jun 26 03:09:00.788825 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 281/571] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:00 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:01.723143 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9e77147d-616d-4f06-803e-61337c9b73f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:01.724319 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9e77147d-616d-4f06-803e-61337c9b73f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:01.730641 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9e77147d-616d-4f06-803e-61337c9b73f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:01.731088 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9e77147d-616d-4f06-803e-61337c9b73f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:01.731903 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9e77147d-616d-4f06-803e-61337c9b73f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:01.732337 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9e77147d-616d-4f06-803e-61337c9b73f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:01.806682 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-33595143-46ba-4a29-80a1-35495d380ea8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:01.807294 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-33595143-46ba-4a29-80a1-35495d380ea8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:01.813902 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-33595143-46ba-4a29-80a1-35495d380ea8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:01.814832 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-33595143-46ba-4a29-80a1-35495d380ea8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:01.815154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-33595143-46ba-4a29-80a1-35495d380ea8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:01.815985 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-33595143-46ba-4a29-80a1-35495d380ea8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:01.899036 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-33595143-46ba-4a29-80a1-35495d380ea8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:01.900142 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9e77147d-616d-4f06-803e-61337c9b73f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:01.908897 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9e77147d-616d-4f06-803e-61337c9b73f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:01.910425 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9e77147d-616d-4f06-803e-61337c9b73f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:01.912259 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9e77147d-616d-4f06-803e-61337c9b73f7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.193017 Jun 26 03:09:01.912613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-33595143-46ba-4a29-80a1-35495d380ea8 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.110730 Jun 26 03:09:01.912820 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 291/572] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:01 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:01.918147 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 282/573] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:01 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:02.930926 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d37a1349-feff-47e3-bf0f-c28bcb487c72 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:02.931521 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d37a1349-feff-47e3-bf0f-c28bcb487c72 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:02.939897 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a738075b-6118-40bf-93c4-2a09df7543de tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:02.940457 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d37a1349-feff-47e3-bf0f-c28bcb487c72 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:02.940457 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d37a1349-feff-47e3-bf0f-c28bcb487c72 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:02.941226 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d37a1349-feff-47e3-bf0f-c28bcb487c72 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:02.941453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a738075b-6118-40bf-93c4-2a09df7543de tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:02.942691 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d37a1349-feff-47e3-bf0f-c28bcb487c72 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:02.951282 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a738075b-6118-40bf-93c4-2a09df7543de tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:02.951748 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a738075b-6118-40bf-93c4-2a09df7543de tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:02.952586 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a738075b-6118-40bf-93c4-2a09df7543de tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:02.953032 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a738075b-6118-40bf-93c4-2a09df7543de tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:03.045601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a738075b-6118-40bf-93c4-2a09df7543de tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:03.053769 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a738075b-6118-40bf-93c4-2a09df7543de tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.118154 Jun 26 03:09:03.054414 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 283/574] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:02 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:09:03.099657 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d37a1349-feff-47e3-bf0f-c28bcb487c72 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:03.108043 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d37a1349-feff-47e3-bf0f-c28bcb487c72 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:03.109486 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d37a1349-feff-47e3-bf0f-c28bcb487c72 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:03.110662 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d37a1349-feff-47e3-bf0f-c28bcb487c72 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.184106 Jun 26 03:09:03.111222 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 292/575] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:02 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:04.071166 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-79bb9fa3-d3c0-427e-bedd-f8413ddc22fa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:04.071782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-79bb9fa3-d3c0-427e-bedd-f8413ddc22fa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:04.078326 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-79bb9fa3-d3c0-427e-bedd-f8413ddc22fa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:04.078766 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-79bb9fa3-d3c0-427e-bedd-f8413ddc22fa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:04.079526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-79bb9fa3-d3c0-427e-bedd-f8413ddc22fa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:04.079965 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-79bb9fa3-d3c0-427e-bedd-f8413ddc22fa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:04.130515 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b9d56bbe-3418-49d8-bac5-cddb7887a631 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:04.131192 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b9d56bbe-3418-49d8-bac5-cddb7887a631 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:04.138066 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b9d56bbe-3418-49d8-bac5-cddb7887a631 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:04.138529 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b9d56bbe-3418-49d8-bac5-cddb7887a631 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:04.139317 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b9d56bbe-3418-49d8-bac5-cddb7887a631 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:04.140096 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b9d56bbe-3418-49d8-bac5-cddb7887a631 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:04.142126 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-79bb9fa3-d3c0-427e-bedd-f8413ddc22fa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:04.150302 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-79bb9fa3-d3c0-427e-bedd-f8413ddc22fa tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.083497 Jun 26 03:09:04.151253 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 284/576] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:04 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:04.285194 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b9d56bbe-3418-49d8-bac5-cddb7887a631 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:04.295891 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b9d56bbe-3418-49d8-bac5-cddb7887a631 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:04.297387 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b9d56bbe-3418-49d8-bac5-cddb7887a631 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:04.298609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b9d56bbe-3418-49d8-bac5-cddb7887a631 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.173028 Jun 26 03:09:04.299168 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 293/577] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:04 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:09:05.167743 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a5cbbf5c-9058-478d-9f22-1a93f0bb44eb tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:05.169294 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a5cbbf5c-9058-478d-9f22-1a93f0bb44eb tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:05.176387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a5cbbf5c-9058-478d-9f22-1a93f0bb44eb tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:05.176920 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a5cbbf5c-9058-478d-9f22-1a93f0bb44eb tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:05.177951 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a5cbbf5c-9058-478d-9f22-1a93f0bb44eb tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:05.178471 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a5cbbf5c-9058-478d-9f22-1a93f0bb44eb tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:05.238754 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a5cbbf5c-9058-478d-9f22-1a93f0bb44eb tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:05.245936 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a5cbbf5c-9058-478d-9f22-1a93f0bb44eb tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.082345 Jun 26 03:09:05.246521 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 285/578] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:05 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:09:05.318539 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3c974f64-7db0-49d9-b175-09764fc14336 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:05.319147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3c974f64-7db0-49d9-b175-09764fc14336 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:05.320958 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=2 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:05.322181 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=6 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:05.327859 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c974f64-7db0-49d9-b175-09764fc14336 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:05.328308 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c974f64-7db0-49d9-b175-09764fc14336 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:05.329061 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c974f64-7db0-49d9-b175-09764fc14336 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:05.329493 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c974f64-7db0-49d9-b175-09764fc14336 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:05.466188 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3c974f64-7db0-49d9-b175-09764fc14336 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:05.475140 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3c974f64-7db0-49d9-b175-09764fc14336 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:05.476643 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3c974f64-7db0-49d9-b175-09764fc14336 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:05.477807 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3c974f64-7db0-49d9-b175-09764fc14336 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.163187 Jun 26 03:09:05.483922 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 294/579] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:05 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:06.264654 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-68bb7501-a17a-4b2f-a0a0-2f0c3de60be3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:06.265364 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-68bb7501-a17a-4b2f-a0a0-2f0c3de60be3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:06.272214 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=2 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:06.275646 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-68bb7501-a17a-4b2f-a0a0-2f0c3de60be3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:06.276539 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-68bb7501-a17a-4b2f-a0a0-2f0c3de60be3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:06.278062 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-68bb7501-a17a-4b2f-a0a0-2f0c3de60be3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:06.278751 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-68bb7501-a17a-4b2f-a0a0-2f0c3de60be3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:06.343833 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-68bb7501-a17a-4b2f-a0a0-2f0c3de60be3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:06.353412 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-68bb7501-a17a-4b2f-a0a0-2f0c3de60be3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.093987 Jun 26 03:09:06.355444 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 286/580] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:06 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:06.499283 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-daa0dfe4-7fbb-40be-a725-6da1562bac5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:06.499916 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-daa0dfe4-7fbb-40be-a725-6da1562bac5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:06.506590 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-daa0dfe4-7fbb-40be-a725-6da1562bac5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:06.507044 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-daa0dfe4-7fbb-40be-a725-6da1562bac5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:06.507793 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-daa0dfe4-7fbb-40be-a725-6da1562bac5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:06.508225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-daa0dfe4-7fbb-40be-a725-6da1562bac5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:06.646977 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-daa0dfe4-7fbb-40be-a725-6da1562bac5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:06.655372 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-daa0dfe4-7fbb-40be-a725-6da1562bac5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:06.656878 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-daa0dfe4-7fbb-40be-a725-6da1562bac5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:06.658031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-daa0dfe4-7fbb-40be-a725-6da1562bac5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.162603 Jun 26 03:09:06.658605 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 295/581] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:06 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:07.371130 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-44739be7-300d-4ef2-bdf7-e0430b3017fd tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:07.371743 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-44739be7-300d-4ef2-bdf7-e0430b3017fd tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:07.378166 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-44739be7-300d-4ef2-bdf7-e0430b3017fd tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:07.378872 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-44739be7-300d-4ef2-bdf7-e0430b3017fd tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:07.380304 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-44739be7-300d-4ef2-bdf7-e0430b3017fd tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:07.380743 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-44739be7-300d-4ef2-bdf7-e0430b3017fd tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:07.445833 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-44739be7-300d-4ef2-bdf7-e0430b3017fd tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:07.453165 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-44739be7-300d-4ef2-bdf7-e0430b3017fd tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.085948 Jun 26 03:09:07.453728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 287/582] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:07 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:09:07.677574 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d13c12ad-d52e-4ab7-8396-f739d556378f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:07.678209 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d13c12ad-d52e-4ab7-8396-f739d556378f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:07.680407 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:07.686592 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d13c12ad-d52e-4ab7-8396-f739d556378f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:07.687052 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d13c12ad-d52e-4ab7-8396-f739d556378f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:07.687826 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d13c12ad-d52e-4ab7-8396-f739d556378f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:07.688265 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d13c12ad-d52e-4ab7-8396-f739d556378f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:07.824168 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d13c12ad-d52e-4ab7-8396-f739d556378f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:07.833041 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d13c12ad-d52e-4ab7-8396-f739d556378f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:07.835352 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d13c12ad-d52e-4ab7-8396-f739d556378f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:07.836542 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d13c12ad-d52e-4ab7-8396-f739d556378f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.163750 Jun 26 03:09:07.837108 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 296/583] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:07 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:08.470821 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-47509e64-9a1a-423e-aeb8-700d996e7fad tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:08.471478 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-47509e64-9a1a-423e-aeb8-700d996e7fad tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:08.478188 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-47509e64-9a1a-423e-aeb8-700d996e7fad tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:08.478643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-47509e64-9a1a-423e-aeb8-700d996e7fad tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:08.479409 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-47509e64-9a1a-423e-aeb8-700d996e7fad tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:08.479843 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-47509e64-9a1a-423e-aeb8-700d996e7fad tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:08.540765 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-47509e64-9a1a-423e-aeb8-700d996e7fad tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:08.544050 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:08.550320 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-47509e64-9a1a-423e-aeb8-700d996e7fad tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.083689 Jun 26 03:09:08.550911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 288/584] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:08 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:08.858306 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c97970ec-8cb9-4d64-af0b-1e6e64bb08e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:08.858964 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c97970ec-8cb9-4d64-af0b-1e6e64bb08e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:08.866098 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c97970ec-8cb9-4d64-af0b-1e6e64bb08e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:08.866559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c97970ec-8cb9-4d64-af0b-1e6e64bb08e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:08.867409 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c97970ec-8cb9-4d64-af0b-1e6e64bb08e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:08.867863 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c97970ec-8cb9-4d64-af0b-1e6e64bb08e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:09.000667 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c97970ec-8cb9-4d64-af0b-1e6e64bb08e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:09.010921 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c97970ec-8cb9-4d64-af0b-1e6e64bb08e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:09.012441 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c97970ec-8cb9-4d64-af0b-1e6e64bb08e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:09.013585 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c97970ec-8cb9-4d64-af0b-1e6e64bb08e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.159637 Jun 26 03:09:09.014152 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 297/585] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:08 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:09.568064 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8b1e4d03-711b-4287-9454-9eb9513d31ac tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:09.568844 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8b1e4d03-711b-4287-9454-9eb9513d31ac tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:09.576456 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8b1e4d03-711b-4287-9454-9eb9513d31ac tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:09.576916 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8b1e4d03-711b-4287-9454-9eb9513d31ac tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:09.577687 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8b1e4d03-711b-4287-9454-9eb9513d31ac tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:09.578163 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8b1e4d03-711b-4287-9454-9eb9513d31ac tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:09.641735 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8b1e4d03-711b-4287-9454-9eb9513d31ac tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:09.650302 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8b1e4d03-711b-4287-9454-9eb9513d31ac tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.086605 Jun 26 03:09:09.650888 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 289/586] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:09 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:10.031591 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6db057d3-d039-4c7b-9f8b-0ee488bda763 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:10.032206 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-6db057d3-d039-4c7b-9f8b-0ee488bda763 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:10.038742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6db057d3-d039-4c7b-9f8b-0ee488bda763 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:10.039199 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6db057d3-d039-4c7b-9f8b-0ee488bda763 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:10.039969 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6db057d3-d039-4c7b-9f8b-0ee488bda763 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:10.040413 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6db057d3-d039-4c7b-9f8b-0ee488bda763 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:10.169223 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6db057d3-d039-4c7b-9f8b-0ee488bda763 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:10.178109 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6db057d3-d039-4c7b-9f8b-0ee488bda763 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:10.179661 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6db057d3-d039-4c7b-9f8b-0ee488bda763 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:10.180829 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6db057d3-d039-4c7b-9f8b-0ee488bda763 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.153095 Jun 26 03:09:10.181374 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 298/587] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:10 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:10.666410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-786d70ef-903d-4b53-908a-f23f4763901e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:10.667063 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-786d70ef-903d-4b53-908a-f23f4763901e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:10.673439 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-786d70ef-903d-4b53-908a-f23f4763901e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:10.673889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-786d70ef-903d-4b53-908a-f23f4763901e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:10.674678 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-786d70ef-903d-4b53-908a-f23f4763901e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:10.675118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-786d70ef-903d-4b53-908a-f23f4763901e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:10.735579 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-786d70ef-903d-4b53-908a-f23f4763901e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:10.742875 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-786d70ef-903d-4b53-908a-f23f4763901e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.080270 Jun 26 03:09:10.743440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 290/588] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:10 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:11.199194 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-97d3c285-644c-427e-aee6-3257120768eb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:11.199810 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-97d3c285-644c-427e-aee6-3257120768eb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:11.206306 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-97d3c285-644c-427e-aee6-3257120768eb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:11.206771 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-97d3c285-644c-427e-aee6-3257120768eb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:11.207546 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-97d3c285-644c-427e-aee6-3257120768eb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:11.207987 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-97d3c285-644c-427e-aee6-3257120768eb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:11.334878 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-97d3c285-644c-427e-aee6-3257120768eb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:11.343373 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-97d3c285-644c-427e-aee6-3257120768eb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:11.344893 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-97d3c285-644c-427e-aee6-3257120768eb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:11.346067 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-97d3c285-644c-427e-aee6-3257120768eb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.150764 Jun 26 03:09:11.346640 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 299/589] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:11 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:11.759888 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8d9f1fb5-36fe-47ec-8025-81514df3ad80 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:11.761110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8d9f1fb5-36fe-47ec-8025-81514df3ad80 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:11.767525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8d9f1fb5-36fe-47ec-8025-81514df3ad80 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:11.767967 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8d9f1fb5-36fe-47ec-8025-81514df3ad80 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:11.768716 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8d9f1fb5-36fe-47ec-8025-81514df3ad80 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:11.769145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8d9f1fb5-36fe-47ec-8025-81514df3ad80 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:11.831844 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8d9f1fb5-36fe-47ec-8025-81514df3ad80 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:11.839476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8d9f1fb5-36fe-47ec-8025-81514df3ad80 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.083410 Jun 26 03:09:11.840033 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 291/590] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:11 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:12.364963 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e435bb07-3961-4d6d-9a90-e142d8aee9d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:12.365568 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e435bb07-3961-4d6d-9a90-e142d8aee9d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:12.372094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e435bb07-3961-4d6d-9a90-e142d8aee9d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:12.372539 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e435bb07-3961-4d6d-9a90-e142d8aee9d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:12.373291 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e435bb07-3961-4d6d-9a90-e142d8aee9d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:12.373723 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e435bb07-3961-4d6d-9a90-e142d8aee9d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:12.498243 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e435bb07-3961-4d6d-9a90-e142d8aee9d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:12.507496 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e435bb07-3961-4d6d-9a90-e142d8aee9d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:12.508983 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e435bb07-3961-4d6d-9a90-e142d8aee9d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:12.510179 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e435bb07-3961-4d6d-9a90-e142d8aee9d9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.149053 Jun 26 03:09:12.510729 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 300/591] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:12 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:12.856568 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7753ec05-e930-4bdc-a5b9-0b60e4f88b7e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:12.857178 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7753ec05-e930-4bdc-a5b9-0b60e4f88b7e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:12.863604 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7753ec05-e930-4bdc-a5b9-0b60e4f88b7e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:12.864055 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7753ec05-e930-4bdc-a5b9-0b60e4f88b7e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:12.864815 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7753ec05-e930-4bdc-a5b9-0b60e4f88b7e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:12.865254 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7753ec05-e930-4bdc-a5b9-0b60e4f88b7e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:12.925158 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7753ec05-e930-4bdc-a5b9-0b60e4f88b7e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:12.932468 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-7753ec05-e930-4bdc-a5b9-0b60e4f88b7e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1271 microversion: 2.1 time: 0.079705 Jun 26 03:09:12.933030 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 292/592] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:12 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1271 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:13.528246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a0da4c01-c237-42f8-8465-2a6ed78de774 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:13.528858 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a0da4c01-c237-42f8-8465-2a6ed78de774 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:13.535386 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0da4c01-c237-42f8-8465-2a6ed78de774 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:13.535846 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0da4c01-c237-42f8-8465-2a6ed78de774 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:13.538661 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0da4c01-c237-42f8-8465-2a6ed78de774 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:13.538661 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0da4c01-c237-42f8-8465-2a6ed78de774 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:13.669059 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a0da4c01-c237-42f8-8465-2a6ed78de774 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:13.677978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a0da4c01-c237-42f8-8465-2a6ed78de774 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:13.679517 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a0da4c01-c237-42f8-8465-2a6ed78de774 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:13.680676 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a0da4c01-c237-42f8-8465-2a6ed78de774 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.156345 Jun 26 03:09:13.681230 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 301/593] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:13 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:13.952285 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-cf8cd5ad-b420-4b9d-b266-aadb52d4134d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:13.952889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-cf8cd5ad-b420-4b9d-b266-aadb52d4134d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:13.959273 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cf8cd5ad-b420-4b9d-b266-aadb52d4134d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:13.959724 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cf8cd5ad-b420-4b9d-b266-aadb52d4134d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:13.960472 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cf8cd5ad-b420-4b9d-b266-aadb52d4134d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:13.960905 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cf8cd5ad-b420-4b9d-b266-aadb52d4134d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:14.021983 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-cf8cd5ad-b420-4b9d-b266-aadb52d4134d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:14.029134 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-cf8cd5ad-b420-4b9d-b266-aadb52d4134d tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1279 microversion: 2.1 time: 0.080653 Jun 26 03:09:14.029699 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 293/594] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:13 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1279 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:14.700618 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-06cca998-18b9-4ad0-8d73-f9d5b443fb87 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:14.701239 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-06cca998-18b9-4ad0-8d73-f9d5b443fb87 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:14.707639 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-06cca998-18b9-4ad0-8d73-f9d5b443fb87 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:14.708696 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-06cca998-18b9-4ad0-8d73-f9d5b443fb87 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:14.709457 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-06cca998-18b9-4ad0-8d73-f9d5b443fb87 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:14.709898 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-06cca998-18b9-4ad0-8d73-f9d5b443fb87 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:14.836866 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-06cca998-18b9-4ad0-8d73-f9d5b443fb87 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:14.845265 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-06cca998-18b9-4ad0-8d73-f9d5b443fb87 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:14.846805 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-06cca998-18b9-4ad0-8d73-f9d5b443fb87 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:14.847980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-06cca998-18b9-4ad0-8d73-f9d5b443fb87 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.151255 Jun 26 03:09:14.848546 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 302/595] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:14 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:15.046663 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-38571a9a-f886-445c-a17c-7ae7698e1d18 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:15.047279 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-38571a9a-f886-445c-a17c-7ae7698e1d18 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:15.053673 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-38571a9a-f886-445c-a17c-7ae7698e1d18 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:15.054144 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-38571a9a-f886-445c-a17c-7ae7698e1d18 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:15.054947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-38571a9a-f886-445c-a17c-7ae7698e1d18 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:15.055391 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-38571a9a-f886-445c-a17c-7ae7698e1d18 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:15.122080 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-38571a9a-f886-445c-a17c-7ae7698e1d18 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:15.129715 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-38571a9a-f886-445c-a17c-7ae7698e1d18 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1277 microversion: 2.1 time: 0.086939 Jun 26 03:09:15.130371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 294/596] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:15 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:15.866952 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-05ef75f5-2fea-4db0-b5aa-c3c4c2459f0d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:15.868013 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-05ef75f5-2fea-4db0-b5aa-c3c4c2459f0d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:15.874641 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-05ef75f5-2fea-4db0-b5aa-c3c4c2459f0d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:15.875103 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-05ef75f5-2fea-4db0-b5aa-c3c4c2459f0d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:15.875921 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-05ef75f5-2fea-4db0-b5aa-c3c4c2459f0d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:15.876367 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-05ef75f5-2fea-4db0-b5aa-c3c4c2459f0d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:16.081335 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-05ef75f5-2fea-4db0-b5aa-c3c4c2459f0d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:16.090400 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-05ef75f5-2fea-4db0-b5aa-c3c4c2459f0d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:16.092017 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-05ef75f5-2fea-4db0-b5aa-c3c4c2459f0d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:16.093174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-05ef75f5-2fea-4db0-b5aa-c3c4c2459f0d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.230731 Jun 26 03:09:16.093726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 303/597] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:15 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:16.147417 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-60744051-65ef-4263-8d69-666193397a34 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:16.148622 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-60744051-65ef-4263-8d69-666193397a34 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:16.154996 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-60744051-65ef-4263-8d69-666193397a34 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:16.155452 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-60744051-65ef-4263-8d69-666193397a34 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:16.156228 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-60744051-65ef-4263-8d69-666193397a34 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:16.156667 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-60744051-65ef-4263-8d69-666193397a34 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:16.361535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-60744051-65ef-4263-8d69-666193397a34 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:16.369721 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-60744051-65ef-4263-8d69-666193397a34 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1319 microversion: 2.1 time: 0.226723 Jun 26 03:09:16.370651 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 295/598] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:16 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:16.390824 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-1a00af72-6338-4180-be17-f24be03cc947 req-07806527-00da-4a70-b82d-e0da8898f920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e25e0db1-7b01-4662-9996-2a928db12453", "tag": "96bb603a-61cc-462c-a8d7-50933c874ba6"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:09:16.400958 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-1a00af72-6338-4180-be17-f24be03cc947 req-07806527-00da-4a70-b82d-e0da8898f920 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:16.401926 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-1a00af72-6338-4180-be17-f24be03cc947 req-07806527-00da-4a70-b82d-e0da8898f920 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:16.413471 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-1a00af72-6338-4180-be17-f24be03cc947 req-07806527-00da-4a70-b82d-e0da8898f920 service nova] Creating event network-changed:96bb603a-61cc-462c-a8d7-50933c874ba6 for instance e25e0db1-7b01-4662-9996-2a928db12453 on hv-cinder-84684 Jun 26 03:09:16.418357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-1a00af72-6338-4180-be17-f24be03cc947 req-07806527-00da-4a70-b82d-e0da8898f920 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031487 Jun 26 03:09:16.418939 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 304/599] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:09:17.111575 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-97630731-f414-4773-b118-da9d3045de19 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:17.112190 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-97630731-f414-4773-b118-da9d3045de19 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:17.119239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-97630731-f414-4773-b118-da9d3045de19 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:17.119681 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-97630731-f414-4773-b118-da9d3045de19 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:17.120452 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-97630731-f414-4773-b118-da9d3045de19 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:17.120890 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-97630731-f414-4773-b118-da9d3045de19 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:17.250993 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-97630731-f414-4773-b118-da9d3045de19 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:17.260241 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-97630731-f414-4773-b118-da9d3045de19 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:17.261741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-97630731-f414-4773-b118-da9d3045de19 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:17.262911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-97630731-f414-4773-b118-da9d3045de19 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.155267 Jun 26 03:09:17.263468 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 296/600] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:17 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:17.388004 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ce46a64d-e5a7-4f70-88d2-e3696e895da3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:17.388701 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ce46a64d-e5a7-4f70-88d2-e3696e895da3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:17.394937 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ce46a64d-e5a7-4f70-88d2-e3696e895da3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:17.395391 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ce46a64d-e5a7-4f70-88d2-e3696e895da3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:17.396148 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ce46a64d-e5a7-4f70-88d2-e3696e895da3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:17.396584 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ce46a64d-e5a7-4f70-88d2-e3696e895da3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:17.522447 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ce46a64d-e5a7-4f70-88d2-e3696e895da3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:17.529815 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ce46a64d-e5a7-4f70-88d2-e3696e895da3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1319 microversion: 2.1 time: 0.146406 Jun 26 03:09:17.530418 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 305/601] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:17 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:18.281205 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c0f4e95f-3055-4e2f-b723-5e88036a74af tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:18.281808 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c0f4e95f-3055-4e2f-b723-5e88036a74af tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:18.288329 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c0f4e95f-3055-4e2f-b723-5e88036a74af tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:18.288777 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c0f4e95f-3055-4e2f-b723-5e88036a74af tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:18.289528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c0f4e95f-3055-4e2f-b723-5e88036a74af tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:18.289957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c0f4e95f-3055-4e2f-b723-5e88036a74af tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:18.416483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c0f4e95f-3055-4e2f-b723-5e88036a74af tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:18.424741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c0f4e95f-3055-4e2f-b723-5e88036a74af tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:18.426264 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c0f4e95f-3055-4e2f-b723-5e88036a74af tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:18.427533 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c0f4e95f-3055-4e2f-b723-5e88036a74af tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.150300 Jun 26 03:09:18.428100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 297/602] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:18 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:18.546918 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2b8d01ea-1f70-4a2f-89e2-b117fa7e1851 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:18.547479 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2b8d01ea-1f70-4a2f-89e2-b117fa7e1851 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:18.554486 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2b8d01ea-1f70-4a2f-89e2-b117fa7e1851 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:18.554944 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2b8d01ea-1f70-4a2f-89e2-b117fa7e1851 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:18.555711 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2b8d01ea-1f70-4a2f-89e2-b117fa7e1851 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:18.556154 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2b8d01ea-1f70-4a2f-89e2-b117fa7e1851 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:18.679585 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-2b8d01ea-1f70-4a2f-89e2-b117fa7e1851 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:18.687640 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2b8d01ea-1f70-4a2f-89e2-b117fa7e1851 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1319 microversion: 2.1 time: 0.144590 Jun 26 03:09:18.688217 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 306/603] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:18 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:19.445650 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2034cef6-a31c-466e-8f09-19cb3f20a291 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:19.446286 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2034cef6-a31c-466e-8f09-19cb3f20a291 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:19.452742 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2034cef6-a31c-466e-8f09-19cb3f20a291 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:19.453193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2034cef6-a31c-466e-8f09-19cb3f20a291 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:19.453951 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2034cef6-a31c-466e-8f09-19cb3f20a291 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:19.454417 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2034cef6-a31c-466e-8f09-19cb3f20a291 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:19.587975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2034cef6-a31c-466e-8f09-19cb3f20a291 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:19.596256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2034cef6-a31c-466e-8f09-19cb3f20a291 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:19.597756 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2034cef6-a31c-466e-8f09-19cb3f20a291 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:19.599601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2034cef6-a31c-466e-8f09-19cb3f20a291 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.157870 Jun 26 03:09:19.600151 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 298/604] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:19 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:19.705387 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6018cb40-718b-44bd-9e5a-1eb265958374 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:19.705909 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-6018cb40-718b-44bd-9e5a-1eb265958374 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:19.712977 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6018cb40-718b-44bd-9e5a-1eb265958374 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:19.713436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6018cb40-718b-44bd-9e5a-1eb265958374 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:19.714245 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6018cb40-718b-44bd-9e5a-1eb265958374 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:19.714690 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6018cb40-718b-44bd-9e5a-1eb265958374 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:19.839016 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6018cb40-718b-44bd-9e5a-1eb265958374 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:19.841278 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=100 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:19.848218 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6018cb40-718b-44bd-9e5a-1eb265958374 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1319 microversion: 2.1 time: 0.147039 Jun 26 03:09:19.848794 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 307/605] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:19 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:20.617953 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e1a4ccbe-5854-4576-b65d-a7fefb7706ff tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:20.618594 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e1a4ccbe-5854-4576-b65d-a7fefb7706ff tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:20.625199 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e1a4ccbe-5854-4576-b65d-a7fefb7706ff tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:20.625655 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e1a4ccbe-5854-4576-b65d-a7fefb7706ff tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:20.626458 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e1a4ccbe-5854-4576-b65d-a7fefb7706ff tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:20.626901 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e1a4ccbe-5854-4576-b65d-a7fefb7706ff tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:20.758479 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e1a4ccbe-5854-4576-b65d-a7fefb7706ff tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:20.766792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e1a4ccbe-5854-4576-b65d-a7fefb7706ff tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:20.768299 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e1a4ccbe-5854-4576-b65d-a7fefb7706ff tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:20.769448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e1a4ccbe-5854-4576-b65d-a7fefb7706ff tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.155975 Jun 26 03:09:20.770002 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 299/606] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:20 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:20.864847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4a7374f8-25c5-40aa-a170-e01325c21030 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:20.865464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4a7374f8-25c5-40aa-a170-e01325c21030 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:20.872065 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4a7374f8-25c5-40aa-a170-e01325c21030 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:20.872519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4a7374f8-25c5-40aa-a170-e01325c21030 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:20.873285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4a7374f8-25c5-40aa-a170-e01325c21030 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:20.873723 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4a7374f8-25c5-40aa-a170-e01325c21030 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:21.000827 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4a7374f8-25c5-40aa-a170-e01325c21030 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:21.008380 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4a7374f8-25c5-40aa-a170-e01325c21030 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1319 microversion: 2.1 time: 0.147587 Jun 26 03:09:21.008944 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 308/607] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:20 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:21.788119 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e44032aa-bfc1-44ba-ac7d-904a550b711f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:21.788725 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e44032aa-bfc1-44ba-ac7d-904a550b711f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:21.795106 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e44032aa-bfc1-44ba-ac7d-904a550b711f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:21.795556 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e44032aa-bfc1-44ba-ac7d-904a550b711f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:21.796310 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e44032aa-bfc1-44ba-ac7d-904a550b711f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:21.796798 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e44032aa-bfc1-44ba-ac7d-904a550b711f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:21.963311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e44032aa-bfc1-44ba-ac7d-904a550b711f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:21.972031 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e44032aa-bfc1-44ba-ac7d-904a550b711f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:21.973670 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e44032aa-bfc1-44ba-ac7d-904a550b711f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:21.975016 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e44032aa-bfc1-44ba-ac7d-904a550b711f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.190792 Jun 26 03:09:21.975573 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 300/608] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:21 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:22.025266 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-dbe6539c-f977-4717-beb3-9726393f6564 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:22.025937 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-dbe6539c-f977-4717-beb3-9726393f6564 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:22.032345 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dbe6539c-f977-4717-beb3-9726393f6564 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:22.032799 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dbe6539c-f977-4717-beb3-9726393f6564 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:22.033566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dbe6539c-f977-4717-beb3-9726393f6564 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:22.034006 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-dbe6539c-f977-4717-beb3-9726393f6564 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:22.241109 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-dbe6539c-f977-4717-beb3-9726393f6564 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:22.248461 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-dbe6539c-f977-4717-beb3-9726393f6564 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1319 microversion: 2.1 time: 0.227613 Jun 26 03:09:22.249060 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 309/609] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:22 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:22.993363 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-133e2316-fdf6-41ac-a96d-2a1d2d93cb5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:22.993965 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-133e2316-fdf6-41ac-a96d-2a1d2d93cb5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:23.000364 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-133e2316-fdf6-41ac-a96d-2a1d2d93cb5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:23.000814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-133e2316-fdf6-41ac-a96d-2a1d2d93cb5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:23.001562 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-133e2316-fdf6-41ac-a96d-2a1d2d93cb5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:23.001994 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-133e2316-fdf6-41ac-a96d-2a1d2d93cb5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:23.126480 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-133e2316-fdf6-41ac-a96d-2a1d2d93cb5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:23.134954 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-133e2316-fdf6-41ac-a96d-2a1d2d93cb5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:23.136455 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-133e2316-fdf6-41ac-a96d-2a1d2d93cb5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:23.137597 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-133e2316-fdf6-41ac-a96d-2a1d2d93cb5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.148878 Jun 26 03:09:23.138225 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 301/610] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:22 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:23.267518 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2206a49f-2327-4e0f-9816-16938152d194 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:23.268132 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2206a49f-2327-4e0f-9816-16938152d194 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:23.275223 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2206a49f-2327-4e0f-9816-16938152d194 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:23.275681 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2206a49f-2327-4e0f-9816-16938152d194 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:23.276448 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2206a49f-2327-4e0f-9816-16938152d194 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:23.276890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2206a49f-2327-4e0f-9816-16938152d194 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:23.403214 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-2206a49f-2327-4e0f-9816-16938152d194 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:23.410599 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2206a49f-2327-4e0f-9816-16938152d194 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1319 microversion: 2.1 time: 0.147838 Jun 26 03:09:23.411194 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 310/611] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:23 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:23.919576 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-84eed78c-bab7-4130-b315-47e3e30a1a00 req-99dfdd01-769e-41c9-bf9b-e60f14030a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25e0db1-7b01-4662-9996-2a928db12453", "name": "network-vif-plugged", "status": "completed", "tag": "96bb603a-61cc-462c-a8d7-50933c874ba6"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:09:23.928898 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-84eed78c-bab7-4130-b315-47e3e30a1a00 req-99dfdd01-769e-41c9-bf9b-e60f14030a9c service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:23.929385 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-84eed78c-bab7-4130-b315-47e3e30a1a00 req-99dfdd01-769e-41c9-bf9b-e60f14030a9c service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:23.943406 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-84eed78c-bab7-4130-b315-47e3e30a1a00 req-99dfdd01-769e-41c9-bf9b-e60f14030a9c service nova] Creating event network-vif-plugged:96bb603a-61cc-462c-a8d7-50933c874ba6 for instance e25e0db1-7b01-4662-9996-2a928db12453 on hv-cinder-84684 Jun 26 03:09:23.948398 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-84eed78c-bab7-4130-b315-47e3e30a1a00 req-99dfdd01-769e-41c9-bf9b-e60f14030a9c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032486 Jun 26 03:09:23.948990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 302/612] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:09:24.156563 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a382e17a-077c-4be9-85ce-5acf32af9178 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:24.157171 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a382e17a-077c-4be9-85ce-5acf32af9178 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:24.163664 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a382e17a-077c-4be9-85ce-5acf32af9178 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:24.164114 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a382e17a-077c-4be9-85ce-5acf32af9178 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:24.164903 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a382e17a-077c-4be9-85ce-5acf32af9178 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:24.165338 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a382e17a-077c-4be9-85ce-5acf32af9178 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:24.297324 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a382e17a-077c-4be9-85ce-5acf32af9178 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:24.306225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a382e17a-077c-4be9-85ce-5acf32af9178 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:24.307719 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a382e17a-077c-4be9-85ce-5acf32af9178 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:24.308849 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a382e17a-077c-4be9-85ce-5acf32af9178 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.156473 Jun 26 03:09:24.309396 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 311/613] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:24 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:24.429024 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8b2e6d24-b039-4097-aa4f-5e18b94774f4 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:24.429648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8b2e6d24-b039-4097-aa4f-5e18b94774f4 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:24.435791 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8b2e6d24-b039-4097-aa4f-5e18b94774f4 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:24.436240 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8b2e6d24-b039-4097-aa4f-5e18b94774f4 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:24.436990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8b2e6d24-b039-4097-aa4f-5e18b94774f4 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:24.437421 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8b2e6d24-b039-4097-aa4f-5e18b94774f4 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:24.569442 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8b2e6d24-b039-4097-aa4f-5e18b94774f4 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:24.576702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8b2e6d24-b039-4097-aa4f-5e18b94774f4 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1319 microversion: 2.1 time: 0.152955 Jun 26 03:09:24.577263 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 303/614] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:24 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:25.327111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0a5ed688-be90-4e51-89ee-de3a980b262c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:25.327656 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0a5ed688-be90-4e51-89ee-de3a980b262c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:25.334183 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0a5ed688-be90-4e51-89ee-de3a980b262c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:25.334640 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0a5ed688-be90-4e51-89ee-de3a980b262c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:25.335402 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0a5ed688-be90-4e51-89ee-de3a980b262c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:25.335846 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0a5ed688-be90-4e51-89ee-de3a980b262c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:25.462416 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0a5ed688-be90-4e51-89ee-de3a980b262c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:25.470764 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0a5ed688-be90-4e51-89ee-de3a980b262c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:25.472275 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0a5ed688-be90-4e51-89ee-de3a980b262c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:25.473441 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0a5ed688-be90-4e51-89ee-de3a980b262c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.150289 Jun 26 03:09:25.473999 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 312/615] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:25 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:25.594096 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5f079d0f-9ab8-4888-b543-675bf664a04e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:25.594657 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5f079d0f-9ab8-4888-b543-675bf664a04e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:25.601506 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5f079d0f-9ab8-4888-b543-675bf664a04e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:25.601971 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5f079d0f-9ab8-4888-b543-675bf664a04e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:25.602755 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5f079d0f-9ab8-4888-b543-675bf664a04e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:25.603193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5f079d0f-9ab8-4888-b543-675bf664a04e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:25.728175 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5f079d0f-9ab8-4888-b543-675bf664a04e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:25.735551 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5f079d0f-9ab8-4888-b543-675bf664a04e tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1319 microversion: 2.1 time: 0.145495 Jun 26 03:09:25.736118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 304/616] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:25 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:09:26.491662 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1337d272-2637-4be4-833f-e7a694afaa24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:26.492314 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1337d272-2637-4be4-833f-e7a694afaa24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:26.499015 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1337d272-2637-4be4-833f-e7a694afaa24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:26.499469 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1337d272-2637-4be4-833f-e7a694afaa24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:26.500235 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1337d272-2637-4be4-833f-e7a694afaa24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:26.500681 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1337d272-2637-4be4-833f-e7a694afaa24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:26.636829 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1337d272-2637-4be4-833f-e7a694afaa24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:26.645075 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1337d272-2637-4be4-833f-e7a694afaa24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:26.647193 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1337d272-2637-4be4-833f-e7a694afaa24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:26.648473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1337d272-2637-4be4-833f-e7a694afaa24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.160691 Jun 26 03:09:26.649036 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 313/617] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:26 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:26.752551 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8516cb4d-8609-4c47-bb09-9901e505b9ab tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:26.753097 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8516cb4d-8609-4c47-bb09-9901e505b9ab tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:26.756489 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=56 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:26.761819 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8516cb4d-8609-4c47-bb09-9901e505b9ab tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:26.762301 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8516cb4d-8609-4c47-bb09-9901e505b9ab tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:26.763075 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8516cb4d-8609-4c47-bb09-9901e505b9ab tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:26.763516 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8516cb4d-8609-4c47-bb09-9901e505b9ab tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:26.896703 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8516cb4d-8609-4c47-bb09-9901e505b9ab tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:26.904232 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8516cb4d-8609-4c47-bb09-9901e505b9ab tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1319 microversion: 2.1 time: 0.155484 Jun 26 03:09:26.904954 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 305/618] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:26 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:27.667141 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e8c2e58a-27de-4e9d-8cb0-af245409ae1a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:27.667753 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e8c2e58a-27de-4e9d-8cb0-af245409ae1a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:27.673743 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e8c2e58a-27de-4e9d-8cb0-af245409ae1a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:27.674234 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e8c2e58a-27de-4e9d-8cb0-af245409ae1a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:27.675001 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e8c2e58a-27de-4e9d-8cb0-af245409ae1a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:27.675438 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e8c2e58a-27de-4e9d-8cb0-af245409ae1a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:27.807784 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e8c2e58a-27de-4e9d-8cb0-af245409ae1a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:27.816169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e8c2e58a-27de-4e9d-8cb0-af245409ae1a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:27.817674 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e8c2e58a-27de-4e9d-8cb0-af245409ae1a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:27.818854 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e8c2e58a-27de-4e9d-8cb0-af245409ae1a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.155766 Jun 26 03:09:27.819416 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 314/619] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:27 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:27.921299 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-71743913-b165-4a2e-9678-b9980377eb32 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:27.921882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-71743913-b165-4a2e-9678-b9980377eb32 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:27.928489 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-71743913-b165-4a2e-9678-b9980377eb32 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:27.928937 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-71743913-b165-4a2e-9678-b9980377eb32 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:27.929701 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-71743913-b165-4a2e-9678-b9980377eb32 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:27.930170 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-71743913-b165-4a2e-9678-b9980377eb32 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:27.934360 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=100 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:27.963577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-86577f8d-819d-4cd9-a084-16d2f6330320 req-a4eb43b5-e722-478f-b165-a5fcd1a1f5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0d1d9b-d025-442c-a2f6-db22050d9059", "name": "network-vif-plugged", "status": "completed", "tag": "52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:09:27.972234 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-86577f8d-819d-4cd9-a084-16d2f6330320 req-a4eb43b5-e722-478f-b165-a5fcd1a1f5bd service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:27.975277 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-86577f8d-819d-4cd9-a084-16d2f6330320 req-a4eb43b5-e722-478f-b165-a5fcd1a1f5bd service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:27.986438 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-86577f8d-819d-4cd9-a084-16d2f6330320 req-a4eb43b5-e722-478f-b165-a5fcd1a1f5bd service nova] Creating event network-vif-plugged:52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f for instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 on hv-cinder-84684 Jun 26 03:09:27.991808 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-86577f8d-819d-4cd9-a084-16d2f6330320 req-a4eb43b5-e722-478f-b165-a5fcd1a1f5bd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031804 Jun 26 03:09:27.992761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 315/620] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:09:28.063418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-71743913-b165-4a2e-9678-b9980377eb32 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:28.071527 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-71743913-b165-4a2e-9678-b9980377eb32 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1509 microversion: 2.1 time: 0.154136 Jun 26 03:09:28.072097 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 306/621] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:27 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:28.088828 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-bc897324-59b1-46ea-82d3-c0debb3e829f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14354fd5-d143-49ec-8a62-33abf63761dd", "device": "/dev/sdb"}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:09:28.090507 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-bc897324-59b1-46ea-82d3-c0debb3e829f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:28.096681 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc897324-59b1-46ea-82d3-c0debb3e829f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:28.097149 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc897324-59b1-46ea-82d3-c0debb3e829f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:28.097914 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc897324-59b1-46ea-82d3-c0debb3e829f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:28.098493 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc897324-59b1-46ea-82d3-c0debb3e829f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:28.735336 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-bc897324-59b1-46ea-82d3-c0debb3e829f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "POST /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.650588 Jun 26 03:09:28.736067 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 316/622] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:09:28 2022] POST /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453/os-volume_attachments => generated 194 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:09:28.836505 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ec5602fc-0ef3-4494-a559-8bfaf3882dce tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:28.837115 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ec5602fc-0ef3-4494-a559-8bfaf3882dce tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:28.843137 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ec5602fc-0ef3-4494-a559-8bfaf3882dce tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:28.843595 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ec5602fc-0ef3-4494-a559-8bfaf3882dce tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:28.844360 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ec5602fc-0ef3-4494-a559-8bfaf3882dce tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:28.844806 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ec5602fc-0ef3-4494-a559-8bfaf3882dce tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:28.971073 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ec5602fc-0ef3-4494-a559-8bfaf3882dce tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:28.979968 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ec5602fc-0ef3-4494-a559-8bfaf3882dce tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:28.981474 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ec5602fc-0ef3-4494-a559-8bfaf3882dce tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:28.982660 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ec5602fc-0ef3-4494-a559-8bfaf3882dce tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.150010 Jun 26 03:09:28.983221 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 307/623] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:28 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:30.002912 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1ed15a37-ea6f-4d86-a563-3ea09ae24435 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:30.003510 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1ed15a37-ea6f-4d86-a563-3ea09ae24435 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:30.011273 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1ed15a37-ea6f-4d86-a563-3ea09ae24435 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:30.011726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1ed15a37-ea6f-4d86-a563-3ea09ae24435 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:30.012483 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1ed15a37-ea6f-4d86-a563-3ea09ae24435 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:30.012921 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1ed15a37-ea6f-4d86-a563-3ea09ae24435 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:30.137899 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1ed15a37-ea6f-4d86-a563-3ea09ae24435 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:30.146591 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1ed15a37-ea6f-4d86-a563-3ea09ae24435 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:30.148076 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1ed15a37-ea6f-4d86-a563-3ea09ae24435 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:30.149213 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1ed15a37-ea6f-4d86-a563-3ea09ae24435 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.151347 Jun 26 03:09:30.149765 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 317/624] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:29 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:31.167382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-302fb0ee-93e3-491d-8f3f-686d420245d2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:31.168003 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-302fb0ee-93e3-491d-8f3f-686d420245d2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:31.174497 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-302fb0ee-93e3-491d-8f3f-686d420245d2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:31.174956 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-302fb0ee-93e3-491d-8f3f-686d420245d2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:31.175721 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-302fb0ee-93e3-491d-8f3f-686d420245d2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:31.176163 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-302fb0ee-93e3-491d-8f3f-686d420245d2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:31.306978 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-302fb0ee-93e3-491d-8f3f-686d420245d2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:31.315247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-302fb0ee-93e3-491d-8f3f-686d420245d2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:31.316754 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-302fb0ee-93e3-491d-8f3f-686d420245d2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:31.318568 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-302fb0ee-93e3-491d-8f3f-686d420245d2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1809 microversion: 2.20 time: 0.155102 Jun 26 03:09:31.319131 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 308/625] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:31 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:32.337240 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4051094b-e554-4d7e-97b5-47d9f35da611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:32.337807 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4051094b-e554-4d7e-97b5-47d9f35da611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:32.344222 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4051094b-e554-4d7e-97b5-47d9f35da611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:32.344681 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4051094b-e554-4d7e-97b5-47d9f35da611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:32.345446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4051094b-e554-4d7e-97b5-47d9f35da611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:32.345888 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4051094b-e554-4d7e-97b5-47d9f35da611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:32.472956 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4051094b-e554-4d7e-97b5-47d9f35da611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:32.481544 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4051094b-e554-4d7e-97b5-47d9f35da611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:32.483355 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4051094b-e554-4d7e-97b5-47d9f35da611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:32.484504 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4051094b-e554-4d7e-97b5-47d9f35da611 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1796 microversion: 2.20 time: 0.151790 Jun 26 03:09:32.485058 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 318/626] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:09:32 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1796 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:09:53.166947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8194dbf7-ac90-423c-89ed-795bbc90b8b0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:53.167461 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8194dbf7-ac90-423c-89ed-795bbc90b8b0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:53.169471 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=7 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:53.170151 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=16 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:53.175932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8194dbf7-ac90-423c-89ed-795bbc90b8b0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:53.176386 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8194dbf7-ac90-423c-89ed-795bbc90b8b0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:53.177650 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8194dbf7-ac90-423c-89ed-795bbc90b8b0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:53.178094 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8194dbf7-ac90-423c-89ed-795bbc90b8b0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:53.316796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-8194dbf7-ac90-423c-89ed-795bbc90b8b0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lazy-loading 'services' on Instance uuid e25e0db1-7b01-4662-9996-2a928db12453 {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:09:53.387742 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8194dbf7-ac90-423c-89ed-795bbc90b8b0 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453/os-volume_attachments/14354fd5-d143-49ec-8a62-33abf63761dd" status: 202 len: 0 microversion: 2.1 time: 0.224643 Jun 26 03:09:53.388330 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 309/627] 10.222.0.13 () {58 vars in 1415 bytes} [Sun Jun 26 03:09:53 2022] DELETE /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453/os-volume_attachments/14354fd5-d143-49ec-8a62-33abf63761dd => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:09:54.359340 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:09:54.359884 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Sun Jun 26 03:09:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:09:54.506788 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d3607730-2469-4250-a968-be24ee47b044 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:54.507294 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d3607730-2469-4250-a968-be24ee47b044 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:54.509802 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=45 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:54.510500 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:54.516186 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d3607730-2469-4250-a968-be24ee47b044 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:54.516623 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d3607730-2469-4250-a968-be24ee47b044 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:54.517418 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d3607730-2469-4250-a968-be24ee47b044 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:54.517853 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d3607730-2469-4250-a968-be24ee47b044 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:54.543633 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d3607730-2469-4250-a968-be24ee47b044 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:09:54.616529 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d3607730-2469-4250-a968-be24ee47b044 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 204 len: 0 microversion: 2.1 time: 0.113975 Jun 26 03:09:54.617161 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 319/628] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:09:54 2022] DELETE /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:09:54.628011 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6645008c-02fe-4349-9941-b35186496ea9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:54.628951 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-6645008c-02fe-4349-9941-b35186496ea9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:54.635678 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6645008c-02fe-4349-9941-b35186496ea9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:54.636128 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6645008c-02fe-4349-9941-b35186496ea9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:54.636881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6645008c-02fe-4349-9941-b35186496ea9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:54.637311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6645008c-02fe-4349-9941-b35186496ea9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:54.768429 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-6645008c-02fe-4349-9941-b35186496ea9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:54.775872 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6645008c-02fe-4349-9941-b35186496ea9 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1515 microversion: 2.1 time: 0.154030 Jun 26 03:09:54.776434 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 310/629] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:54 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:55.793360 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-84ecee9b-9620-4338-b5c1-c051a8f6bcc3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:55.794065 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-84ecee9b-9620-4338-b5c1-c051a8f6bcc3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:55.800390 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-84ecee9b-9620-4338-b5c1-c051a8f6bcc3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:55.800832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-84ecee9b-9620-4338-b5c1-c051a8f6bcc3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:55.801580 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-84ecee9b-9620-4338-b5c1-c051a8f6bcc3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:55.802011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-84ecee9b-9620-4338-b5c1-c051a8f6bcc3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:55.980540 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-84ecee9b-9620-4338-b5c1-c051a8f6bcc3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:55.987889 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-84ecee9b-9620-4338-b5c1-c051a8f6bcc3 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1515 microversion: 2.1 time: 0.198723 Jun 26 03:09:55.988445 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 320/630] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:55 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:57.005172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ada48f26-5e66-419b-adfa-c72dc9e0a307 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:57.005864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ada48f26-5e66-419b-adfa-c72dc9e0a307 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:57.012217 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ada48f26-5e66-419b-adfa-c72dc9e0a307 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:57.012671 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ada48f26-5e66-419b-adfa-c72dc9e0a307 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:57.013463 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ada48f26-5e66-419b-adfa-c72dc9e0a307 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:57.013902 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ada48f26-5e66-419b-adfa-c72dc9e0a307 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:57.239759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ada48f26-5e66-419b-adfa-c72dc9e0a307 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497fd3327d1441c8b3933bda95f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93abb7628324906baa8d45ce8d1a153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:09:57.247316 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ada48f26-5e66-419b-adfa-c72dc9e0a307 tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 200 len: 1515 microversion: 2.1 time: 0.246333 Jun 26 03:09:57.247876 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 311/631] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:56 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 1515 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:09:57.497571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-6bdfb595-8ac1-425f-95e5-16550deb1e4a req-eba789fa-a7de-4168-81a8-95cc5f9fdd25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25e0db1-7b01-4662-9996-2a928db12453", "name": "network-vif-deleted", "tag": "96bb603a-61cc-462c-a8d7-50933c874ba6"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:09:57.509637 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-6bdfb595-8ac1-425f-95e5-16550deb1e4a req-eba789fa-a7de-4168-81a8-95cc5f9fdd25 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:57.510109 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-6bdfb595-8ac1-425f-95e5-16550deb1e4a req-eba789fa-a7de-4168-81a8-95cc5f9fdd25 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:57.523263 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-6bdfb595-8ac1-425f-95e5-16550deb1e4a req-eba789fa-a7de-4168-81a8-95cc5f9fdd25 service nova] Creating event network-vif-deleted:96bb603a-61cc-462c-a8d7-50933c874ba6 for instance e25e0db1-7b01-4662-9996-2a928db12453 on hv-cinder-84684 Jun 26 03:09:57.530089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-6bdfb595-8ac1-425f-95e5-16550deb1e4a req-eba789fa-a7de-4168-81a8-95cc5f9fdd25 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036501 Jun 26 03:09:57.530687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 321/632] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:09:58.264730 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b1885dea-bf84-48d6-bec8-30d577c2315f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:09:58.265262 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b1885dea-bf84-48d6-bec8-30d577c2315f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] [instance: e25e0db1-7b01-4662-9996-2a928db12453] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:09:58.272241 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b1885dea-bf84-48d6-bec8-30d577c2315f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:58.272697 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b1885dea-bf84-48d6-bec8-30d577c2315f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:58.273458 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b1885dea-bf84-48d6-bec8-30d577c2315f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:09:58.273900 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b1885dea-bf84-48d6-bec8-30d577c2315f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:09:58.287431 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-b1885dea-bf84-48d6-bec8-30d577c2315f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] HTTP exception thrown: Instance e25e0db1-7b01-4662-9996-2a928db12453 could not be found. Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b1885dea-bf84-48d6-bec8-30d577c2315f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Request method failure captured: Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 HTTP/1.1 Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit81nuJ4DSXAgQdEbrfpRCZ6LNZHgpUNChCPFyRyOumuW0KGe31kE00suoN-gYwFs99_jEyeWR5rQuTWbkeBXCBFr2VUx_zz9TE1E_Szx9VS-E3nM8g1KdFz50qP4AzmlGdpXW6ea6sfsqMwL1oD3Qbar4VuCX62AUB4DtXnqBKiy_9I Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: f93abb7628324906baa8d45ce8d1a153 Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1670411537 Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:09:58.289026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:09:58.290368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f93abb7628324906baa8d45ce8d1a153"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f93abb7628324906baa8d45ce8d1a153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f93abb7628324906baa8d45ce8d1a153"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f93abb7628324906baa8d45ce8d1a153"}]}] Jun 26 03:09:58.290368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-VolumesSnapshotTestJSON-1670411537 Jun 26 03:09:58.290368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: f93abb7628324906baa8d45ce8d1a153 Jun 26 03:09:58.290368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1670411537 Jun 26 03:09:58.290368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-VolumesSnapshotTestJSON-1670411537-project Jun 26 03:09:58.290368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:09:58.290368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:09:58.290368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 497fd3327d1441c8b3933bda95f673af Jun 26 03:09:58.290368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-VolumesSnapshotTestJSON-1670411537-project Jun 26 03:09:58.290368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:09:58.290368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance e25e0db1-7b01-4662-9996-2a928db12453 could not be found. Jun 26 03:09:58.290368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': 'e25e0db1-7b01-4662-9996-2a928db12453'} Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e25e0db1-7b01-4662-9996-2a928db12453 could not be found. Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:09:58.291135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e25e0db1-7b01-4662-9996-2a928db12453 could not be found. Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e25e0db1-7b01-4662-9996-2a928db12453 could not be found. Jun 26 03:09:58.292528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:09:58.294118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b1885dea-bf84-48d6-bec8-30d577c2315f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] Returning 404 to user: Instance e25e0db1-7b01-4662-9996-2a928db12453 could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:09:58.294118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b1885dea-bf84-48d6-bec8-30d577c2315f tempest-VolumesSnapshotTestJSON-1670411537 tempest-VolumesSnapshotTestJSON-1670411537-project] 10.222.0.13 "GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453" status: 404 len: 111 microversion: 2.1 time: 0.029641 Jun 26 03:09:58.294118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 312/633] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:09:58 2022] GET /compute/v2.1/servers/e25e0db1-7b01-4662-9996-2a928db12453 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:10:04.823900 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4cee2397-3b73-4c62-b26b-d85cb4607b80 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:04.824476 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4cee2397-3b73-4c62-b26b-d85cb4607b80 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:04.830536 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4cee2397-3b73-4c62-b26b-d85cb4607b80 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:04.830989 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4cee2397-3b73-4c62-b26b-d85cb4607b80 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:04.831741 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4cee2397-3b73-4c62-b26b-d85cb4607b80 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:04.832174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4cee2397-3b73-4c62-b26b-d85cb4607b80 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:04.954721 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.objects.instance [None req-4cee2397-3b73-4c62-b26b-d85cb4607b80 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lazy-loading 'services' on Instance uuid 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d {{(pid=117783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:10:05.067376 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4cee2397-3b73-4c62-b26b-d85cb4607b80 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/os-volume_attachments/4ea326be-5b31-4d0c-8f81-5b5b807b7bf5" status: 202 len: 0 microversion: 2.1 time: 0.346540 Jun 26 03:10:05.068651 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 322/634] 10.222.0.13 () {58 vars in 1415 bytes} [Sun Jun 26 03:10:04 2022] DELETE /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/os-volume_attachments/4ea326be-5b31-4d0c-8f81-5b5b807b7bf5 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:10:07.233683 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7f40a02d-9607-4b96-bd35-0115819234a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:07.242537 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7f40a02d-9607-4b96-bd35-0115819234a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:07.243167 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7f40a02d-9607-4b96-bd35-0115819234a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:07.267285 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7f40a02d-9607-4b96-bd35-0115819234a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Going to try to stop instance {{(pid=117782) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 26 03:10:07.307092 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-7f40a02d-9607-4b96-bd35-0115819234a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "POST /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.076954 Jun 26 03:10:07.307699 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 313/635] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:10:07 2022] POST /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:10:07.316892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-850a3af3-c412-4e36-bb4e-cec0bbd587f2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:07.318281 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-850a3af3-c412-4e36-bb4e-cec0bbd587f2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:07.325945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-850a3af3-c412-4e36-bb4e-cec0bbd587f2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:07.326464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-850a3af3-c412-4e36-bb4e-cec0bbd587f2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:07.327333 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-850a3af3-c412-4e36-bb4e-cec0bbd587f2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:07.327781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-850a3af3-c412-4e36-bb4e-cec0bbd587f2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:07.456628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-850a3af3-c412-4e36-bb4e-cec0bbd587f2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:07.464552 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-850a3af3-c412-4e36-bb4e-cec0bbd587f2 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.152439 Jun 26 03:10:07.465125 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 323/636] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:07 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:08.481666 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-06c054f9-09d2-4bf7-8f22-8d48658c2e83 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:08.482395 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-06c054f9-09d2-4bf7-8f22-8d48658c2e83 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:08.488620 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-06c054f9-09d2-4bf7-8f22-8d48658c2e83 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:08.489075 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-06c054f9-09d2-4bf7-8f22-8d48658c2e83 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:08.489898 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-06c054f9-09d2-4bf7-8f22-8d48658c2e83 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:08.490377 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-06c054f9-09d2-4bf7-8f22-8d48658c2e83 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:08.622359 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-06c054f9-09d2-4bf7-8f22-8d48658c2e83 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:08.630731 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-06c054f9-09d2-4bf7-8f22-8d48658c2e83 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.153111 Jun 26 03:10:08.631299 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 314/637] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:08 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:09.648696 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-187c6b09-30dc-4193-9b88-bad9bd377df0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:09.649317 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-187c6b09-30dc-4193-9b88-bad9bd377df0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:09.655910 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-187c6b09-30dc-4193-9b88-bad9bd377df0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:09.656370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-187c6b09-30dc-4193-9b88-bad9bd377df0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:09.657135 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-187c6b09-30dc-4193-9b88-bad9bd377df0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:09.657578 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-187c6b09-30dc-4193-9b88-bad9bd377df0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:09.788362 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-187c6b09-30dc-4193-9b88-bad9bd377df0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:09.795729 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-187c6b09-30dc-4193-9b88-bad9bd377df0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.151407 Jun 26 03:10:09.796288 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 324/638] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:09 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:10.813391 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fdfffc50-be56-488b-aa8d-0ad02b29d674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:10.813906 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-fdfffc50-be56-488b-aa8d-0ad02b29d674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:10.820810 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fdfffc50-be56-488b-aa8d-0ad02b29d674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:10.821251 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fdfffc50-be56-488b-aa8d-0ad02b29d674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:10.822000 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fdfffc50-be56-488b-aa8d-0ad02b29d674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:10.822460 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fdfffc50-be56-488b-aa8d-0ad02b29d674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:10.953123 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-fdfffc50-be56-488b-aa8d-0ad02b29d674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:10.960647 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-fdfffc50-be56-488b-aa8d-0ad02b29d674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.151159 Jun 26 03:10:10.961197 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 315/639] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:10 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:11.977014 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-bfa5e022-0925-40eb-b0e7-2c7bb22e246e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:11.977617 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-bfa5e022-0925-40eb-b0e7-2c7bb22e246e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:11.983911 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bfa5e022-0925-40eb-b0e7-2c7bb22e246e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:11.984356 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bfa5e022-0925-40eb-b0e7-2c7bb22e246e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:11.985111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bfa5e022-0925-40eb-b0e7-2c7bb22e246e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:11.985545 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bfa5e022-0925-40eb-b0e7-2c7bb22e246e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:12.109645 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bfa5e022-0925-40eb-b0e7-2c7bb22e246e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:12.116977 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-bfa5e022-0925-40eb-b0e7-2c7bb22e246e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.144349 Jun 26 03:10:12.117528 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 325/640] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:11 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:13.133821 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-dfcb2537-9efd-49cb-b51a-500e32dd270c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:13.134475 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-dfcb2537-9efd-49cb-b51a-500e32dd270c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:13.141159 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dfcb2537-9efd-49cb-b51a-500e32dd270c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:13.141630 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dfcb2537-9efd-49cb-b51a-500e32dd270c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:13.142425 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dfcb2537-9efd-49cb-b51a-500e32dd270c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:13.142863 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dfcb2537-9efd-49cb-b51a-500e32dd270c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:13.273648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-dfcb2537-9efd-49cb-b51a-500e32dd270c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:13.281154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-dfcb2537-9efd-49cb-b51a-500e32dd270c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.151107 Jun 26 03:10:13.281724 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 316/641] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:13 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:14.298790 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-50c007d4-0141-409c-8951-2d76c8ba8293 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:14.299970 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-50c007d4-0141-409c-8951-2d76c8ba8293 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:14.307515 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-50c007d4-0141-409c-8951-2d76c8ba8293 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:14.307994 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-50c007d4-0141-409c-8951-2d76c8ba8293 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:14.308766 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-50c007d4-0141-409c-8951-2d76c8ba8293 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:14.309522 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-50c007d4-0141-409c-8951-2d76c8ba8293 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:14.440338 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-50c007d4-0141-409c-8951-2d76c8ba8293 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:14.447678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-50c007d4-0141-409c-8951-2d76c8ba8293 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.152902 Jun 26 03:10:14.448237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 326/642] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:14 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:15.464495 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-24109925-c70f-4817-934d-d30cbbe87ca5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:15.465109 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-24109925-c70f-4817-934d-d30cbbe87ca5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:15.470995 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-24109925-c70f-4817-934d-d30cbbe87ca5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:15.471441 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-24109925-c70f-4817-934d-d30cbbe87ca5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:15.472196 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-24109925-c70f-4817-934d-d30cbbe87ca5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:15.472629 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-24109925-c70f-4817-934d-d30cbbe87ca5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:15.603864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-24109925-c70f-4817-934d-d30cbbe87ca5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:15.611287 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-24109925-c70f-4817-934d-d30cbbe87ca5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.150680 Jun 26 03:10:15.611788 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 317/643] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:15 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:15.929264 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6427954a-b975-49e5-9f48-cd3ad2efd83b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20c918cc-3f6e-49aa-a1dc-3810fee01984"}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:15.930457 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-6427954a-b975-49e5-9f48-cd3ad2efd83b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:15.936398 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6427954a-b975-49e5-9f48-cd3ad2efd83b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:15.936862 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6427954a-b975-49e5-9f48-cd3ad2efd83b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:15.937632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6427954a-b975-49e5-9f48-cd3ad2efd83b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:15.938100 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6427954a-b975-49e5-9f48-cd3ad2efd83b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:16.190034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6427954a-b975-49e5-9f48-cd3ad2efd83b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "POST /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313197 Jun 26 03:10:16.190856 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 327/644] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:10:15 2022] POST /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:10:16.628471 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4fd095f6-52e9-46dd-a761-3223c4f7ceaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:16.630383 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4fd095f6-52e9-46dd-a761-3223c4f7ceaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:16.637583 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4fd095f6-52e9-46dd-a761-3223c4f7ceaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:16.638101 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4fd095f6-52e9-46dd-a761-3223c4f7ceaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:16.638880 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4fd095f6-52e9-46dd-a761-3223c4f7ceaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:16.639312 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4fd095f6-52e9-46dd-a761-3223c4f7ceaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:16.768094 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4fd095f6-52e9-46dd-a761-3223c4f7ceaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:16.776168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4fd095f6-52e9-46dd-a761-3223c4f7ceaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.151532 Jun 26 03:10:16.776736 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 318/645] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:16 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:17.794540 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b87636a1-6c26-484d-8c6f-100665163101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:17.795245 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b87636a1-6c26-484d-8c6f-100665163101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:17.801398 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b87636a1-6c26-484d-8c6f-100665163101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:17.801849 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b87636a1-6c26-484d-8c6f-100665163101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:17.802639 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b87636a1-6c26-484d-8c6f-100665163101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:17.803171 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b87636a1-6c26-484d-8c6f-100665163101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:17.930555 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b87636a1-6c26-484d-8c6f-100665163101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:17.937822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b87636a1-6c26-484d-8c6f-100665163101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.148100 Jun 26 03:10:17.938413 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 328/646] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:17 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:18.954715 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-06d42459-122c-4beb-a802-68a32778b674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:18.955326 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-06d42459-122c-4beb-a802-68a32778b674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:18.961838 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-06d42459-122c-4beb-a802-68a32778b674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:18.962337 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-06d42459-122c-4beb-a802-68a32778b674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:18.963101 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-06d42459-122c-4beb-a802-68a32778b674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:18.963539 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-06d42459-122c-4beb-a802-68a32778b674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:19.091618 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-06d42459-122c-4beb-a802-68a32778b674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:19.098921 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-06d42459-122c-4beb-a802-68a32778b674 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.148053 Jun 26 03:10:19.099472 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 319/647] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:18 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:10:20.116917 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1437b23b-bfcc-4743-8c5f-45ec1919117d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:20.117462 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1437b23b-bfcc-4743-8c5f-45ec1919117d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:20.124025 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1437b23b-bfcc-4743-8c5f-45ec1919117d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:20.124478 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1437b23b-bfcc-4743-8c5f-45ec1919117d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:20.125259 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1437b23b-bfcc-4743-8c5f-45ec1919117d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:20.125703 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1437b23b-bfcc-4743-8c5f-45ec1919117d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:20.252551 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1437b23b-bfcc-4743-8c5f-45ec1919117d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:20.261327 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1437b23b-bfcc-4743-8c5f-45ec1919117d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.148843 Jun 26 03:10:20.261910 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 329/648] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:20 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:21.278875 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-da895d32-2ac6-461a-88f1-014410c595eb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:21.279483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-da895d32-2ac6-461a-88f1-014410c595eb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:21.285990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-da895d32-2ac6-461a-88f1-014410c595eb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:21.286473 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-da895d32-2ac6-461a-88f1-014410c595eb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:21.287346 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-da895d32-2ac6-461a-88f1-014410c595eb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:21.287780 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-da895d32-2ac6-461a-88f1-014410c595eb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:21.413207 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-da895d32-2ac6-461a-88f1-014410c595eb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:21.420506 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-da895d32-2ac6-461a-88f1-014410c595eb tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.145530 Jun 26 03:10:21.421063 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 320/649] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:21 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:22.437889 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ae1bb4bb-abe7-49e0-991e-8f6da2ea602f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:22.438570 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ae1bb4bb-abe7-49e0-991e-8f6da2ea602f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:22.444907 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ae1bb4bb-abe7-49e0-991e-8f6da2ea602f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:22.445366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ae1bb4bb-abe7-49e0-991e-8f6da2ea602f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:22.446406 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ae1bb4bb-abe7-49e0-991e-8f6da2ea602f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:22.446725 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ae1bb4bb-abe7-49e0-991e-8f6da2ea602f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:22.582501 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ae1bb4bb-abe7-49e0-991e-8f6da2ea602f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:22.590520 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ae1bb4bb-abe7-49e0-991e-8f6da2ea602f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.156393 Jun 26 03:10:22.591085 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 330/650] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:22 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:23.607950 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9ca4abe9-3726-469c-a082-b4215364f93c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:23.609115 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9ca4abe9-3726-469c-a082-b4215364f93c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:23.611790 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=25 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:10:23.617766 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ca4abe9-3726-469c-a082-b4215364f93c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:23.618354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ca4abe9-3726-469c-a082-b4215364f93c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:23.619206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ca4abe9-3726-469c-a082-b4215364f93c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:23.619728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ca4abe9-3726-469c-a082-b4215364f93c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:23.624937 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:10:23.678355 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ff4c4497-c641-474d-b00e-d63bd8ef2bbb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:23.679476 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ff4c4497-c641-474d-b00e-d63bd8ef2bbb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:23.686594 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ff4c4497-c641-474d-b00e-d63bd8ef2bbb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:23.687197 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ff4c4497-c641-474d-b00e-d63bd8ef2bbb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:23.688698 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ff4c4497-c641-474d-b00e-d63bd8ef2bbb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:23.689896 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ff4c4497-c641-474d-b00e-d63bd8ef2bbb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:23.719708 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.objects.instance [None req-ff4c4497-c641-474d-b00e-d63bd8ef2bbb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lazy-loading 'flavor' on Instance uuid 473e061c-b6d3-4dff-9171-45f7acfaffee {{(pid=117783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:10:23.773935 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9ca4abe9-3726-469c-a082-b4215364f93c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:23.782322 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9ca4abe9-3726-469c-a082-b4215364f93c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.178391 Jun 26 03:10:23.783046 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 321/651] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:23 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:10:23.833147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:10:23.887235 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ff4c4497-c641-474d-b00e-d63bd8ef2bbb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "POST /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/action" status: 200 len: 32 microversion: 2.1 time: 0.212910 Jun 26 03:10:23.887842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 331/652] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:10:23 2022] POST /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 26 03:10:23.897404 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-19690c84-06ad-4564-b9ca-efbe5dca5f80 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:23.898405 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-19690c84-06ad-4564-b9ca-efbe5dca5f80 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:23.905603 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-19690c84-06ad-4564-b9ca-efbe5dca5f80 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:23.906168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-19690c84-06ad-4564-b9ca-efbe5dca5f80 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:23.907173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-19690c84-06ad-4564-b9ca-efbe5dca5f80 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:23.907842 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-19690c84-06ad-4564-b9ca-efbe5dca5f80 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:24.112154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-19690c84-06ad-4564-b9ca-efbe5dca5f80 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:24.120312 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-19690c84-06ad-4564-b9ca-efbe5dca5f80 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1736 microversion: 2.1 time: 0.227190 Jun 26 03:10:24.124513 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 322/653] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:23 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:24.801055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-68659bd8-5bba-437f-a259-7859ba13c47a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:24.801755 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-68659bd8-5bba-437f-a259-7859ba13c47a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:24.803787 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:10:24.810652 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-68659bd8-5bba-437f-a259-7859ba13c47a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:24.811050 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-68659bd8-5bba-437f-a259-7859ba13c47a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:24.811810 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-68659bd8-5bba-437f-a259-7859ba13c47a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:24.812248 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-68659bd8-5bba-437f-a259-7859ba13c47a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:24.938169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-68659bd8-5bba-437f-a259-7859ba13c47a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:24.945682 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-68659bd8-5bba-437f-a259-7859ba13c47a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.149393 Jun 26 03:10:24.946328 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 332/654] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:24 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:25.138133 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-bb069b71-ec47-48fa-bd0a-2534d5ef6ee1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:25.138741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-bb069b71-ec47-48fa-bd0a-2534d5ef6ee1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:25.145076 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bb069b71-ec47-48fa-bd0a-2534d5ef6ee1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:25.145525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bb069b71-ec47-48fa-bd0a-2534d5ef6ee1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:25.146312 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bb069b71-ec47-48fa-bd0a-2534d5ef6ee1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:25.146750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bb069b71-ec47-48fa-bd0a-2534d5ef6ee1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:25.277482 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-bb069b71-ec47-48fa-bd0a-2534d5ef6ee1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:25.285233 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-bb069b71-ec47-48fa-bd0a-2534d5ef6ee1 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1736 microversion: 2.1 time: 0.150950 Jun 26 03:10:25.289872 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 323/655] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:25 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:25.962813 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f7504532-d411-4a85-a35c-67d8bcad3a09 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:25.963417 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f7504532-d411-4a85-a35c-67d8bcad3a09 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:25.969859 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f7504532-d411-4a85-a35c-67d8bcad3a09 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:25.970335 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f7504532-d411-4a85-a35c-67d8bcad3a09 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:25.971085 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f7504532-d411-4a85-a35c-67d8bcad3a09 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:25.971517 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f7504532-d411-4a85-a35c-67d8bcad3a09 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:26.096176 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f7504532-d411-4a85-a35c-67d8bcad3a09 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:26.103653 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f7504532-d411-4a85-a35c-67d8bcad3a09 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.144889 Jun 26 03:10:26.104163 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 333/656] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:25 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:26.302690 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-18a47b7b-3995-4ada-bc84-dd1dc6ec02f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:26.303300 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-18a47b7b-3995-4ada-bc84-dd1dc6ec02f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:26.310360 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-18a47b7b-3995-4ada-bc84-dd1dc6ec02f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:26.310810 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-18a47b7b-3995-4ada-bc84-dd1dc6ec02f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:26.311569 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-18a47b7b-3995-4ada-bc84-dd1dc6ec02f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:26.312009 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-18a47b7b-3995-4ada-bc84-dd1dc6ec02f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:26.439528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-18a47b7b-3995-4ada-bc84-dd1dc6ec02f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:26.447363 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-18a47b7b-3995-4ada-bc84-dd1dc6ec02f5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1736 microversion: 2.1 time: 0.148522 Jun 26 03:10:26.447932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 324/657] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:26 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:27.120413 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fda4c903-c8ab-4000-944b-a0b79d00b2dc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:27.121049 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fda4c903-c8ab-4000-944b-a0b79d00b2dc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:27.127450 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fda4c903-c8ab-4000-944b-a0b79d00b2dc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:27.127899 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fda4c903-c8ab-4000-944b-a0b79d00b2dc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:27.128654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fda4c903-c8ab-4000-944b-a0b79d00b2dc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:27.129340 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fda4c903-c8ab-4000-944b-a0b79d00b2dc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:27.254715 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fda4c903-c8ab-4000-944b-a0b79d00b2dc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:27.262437 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fda4c903-c8ab-4000-944b-a0b79d00b2dc tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1678 microversion: 2.1 time: 0.145833 Jun 26 03:10:27.262997 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 334/658] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:27 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:27.463374 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-06640097-d492-493f-b511-87b5a50adc86 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:27.463935 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-06640097-d492-493f-b511-87b5a50adc86 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:27.470506 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-06640097-d492-493f-b511-87b5a50adc86 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:27.470960 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-06640097-d492-493f-b511-87b5a50adc86 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:27.471751 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-06640097-d492-493f-b511-87b5a50adc86 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:27.472191 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-06640097-d492-493f-b511-87b5a50adc86 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:27.595584 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-06640097-d492-493f-b511-87b5a50adc86 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:27.603665 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-06640097-d492-493f-b511-87b5a50adc86 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1736 microversion: 2.1 time: 0.144148 Jun 26 03:10:27.604243 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 325/659] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:27 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:28.279787 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-5f5c145c-6cf5-442c-a5d4-06941c4001c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:28.280391 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-5f5c145c-6cf5-442c-a5d4-06941c4001c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:28.287086 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5f5c145c-6cf5-442c-a5d4-06941c4001c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:28.287536 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5f5c145c-6cf5-442c-a5d4-06941c4001c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:28.288285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5f5c145c-6cf5-442c-a5d4-06941c4001c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:28.288718 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5f5c145c-6cf5-442c-a5d4-06941c4001c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:28.417617 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-5f5c145c-6cf5-442c-a5d4-06941c4001c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:28.425295 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-5f5c145c-6cf5-442c-a5d4-06941c4001c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1655 microversion: 2.1 time: 0.149363 Jun 26 03:10:28.425848 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 335/660] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:28 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:28.441291 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e0761e8b-61e0-4956-8b31-6437e2bca91c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:28.447256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e0761e8b-61e0-4956-8b31-6437e2bca91c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:28.447706 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e0761e8b-61e0-4956-8b31-6437e2bca91c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:28.469684 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e0761e8b-61e0-4956-8b31-6437e2bca91c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Going to try to start instance {{(pid=117782) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 26 03:10:28.511481 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e0761e8b-61e0-4956-8b31-6437e2bca91c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "POST /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.073432 Jun 26 03:10:28.512150 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 326/661] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:10:28 2022] POST /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:10:28.520355 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-91e27d1c-5b9f-451f-823d-7e0c22a3418e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:28.520976 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-91e27d1c-5b9f-451f-823d-7e0c22a3418e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:28.528389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-91e27d1c-5b9f-451f-823d-7e0c22a3418e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:28.528940 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-91e27d1c-5b9f-451f-823d-7e0c22a3418e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:28.529865 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-91e27d1c-5b9f-451f-823d-7e0c22a3418e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:28.530291 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-91e27d1c-5b9f-451f-823d-7e0c22a3418e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:28.622209 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d41ec5b3-9048-419b-a68f-f8eb0c092bf9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:28.622906 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d41ec5b3-9048-419b-a68f-f8eb0c092bf9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:28.629341 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d41ec5b3-9048-419b-a68f-f8eb0c092bf9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:28.629797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d41ec5b3-9048-419b-a68f-f8eb0c092bf9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:28.630584 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d41ec5b3-9048-419b-a68f-f8eb0c092bf9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:28.631024 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d41ec5b3-9048-419b-a68f-f8eb0c092bf9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:28.948456 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-91e27d1c-5b9f-451f-823d-7e0c22a3418e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:28.955954 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-91e27d1c-5b9f-451f-823d-7e0c22a3418e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1664 microversion: 2.1 time: 0.439415 Jun 26 03:10:28.956521 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 336/662] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:28 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1664 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:10:29.068613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d41ec5b3-9048-419b-a68f-f8eb0c092bf9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:29.077063 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d41ec5b3-9048-419b-a68f-f8eb0c092bf9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1736 microversion: 2.1 time: 0.460126 Jun 26 03:10:29.077634 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 327/663] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:28 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1736 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:10:29.972616 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3d4bdd48-0b07-4d4e-bf09-b7d8004b712e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:29.973225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3d4bdd48-0b07-4d4e-bf09-b7d8004b712e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:29.980365 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3d4bdd48-0b07-4d4e-bf09-b7d8004b712e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:29.980818 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3d4bdd48-0b07-4d4e-bf09-b7d8004b712e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:29.981582 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3d4bdd48-0b07-4d4e-bf09-b7d8004b712e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:29.982024 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3d4bdd48-0b07-4d4e-bf09-b7d8004b712e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:30.094567 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-21a0ef06-6542-4466-abfc-24c622427e2d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:30.095304 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-21a0ef06-6542-4466-abfc-24c622427e2d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:30.101868 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-21a0ef06-6542-4466-abfc-24c622427e2d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:30.102351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-21a0ef06-6542-4466-abfc-24c622427e2d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:30.103127 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-21a0ef06-6542-4466-abfc-24c622427e2d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:30.103543 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-21a0ef06-6542-4466-abfc-24c622427e2d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:30.115771 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3d4bdd48-0b07-4d4e-bf09-b7d8004b712e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:30.123161 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3d4bdd48-0b07-4d4e-bf09-b7d8004b712e tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1664 microversion: 2.1 time: 0.154357 Jun 26 03:10:30.123755 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 337/664] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:29 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:30.234349 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-21a0ef06-6542-4466-abfc-24c622427e2d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:30.242201 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-21a0ef06-6542-4466-abfc-24c622427e2d tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1736 microversion: 2.1 time: 0.151600 Jun 26 03:10:30.242770 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 328/665] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:30 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:31.140581 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-81638d63-bef5-45f1-acb8-c699d14d81ee tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:31.141197 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-81638d63-bef5-45f1-acb8-c699d14d81ee tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:31.147603 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-81638d63-bef5-45f1-acb8-c699d14d81ee tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:31.148067 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-81638d63-bef5-45f1-acb8-c699d14d81ee tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:31.148837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-81638d63-bef5-45f1-acb8-c699d14d81ee tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:31.149782 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-81638d63-bef5-45f1-acb8-c699d14d81ee tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:31.259687 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-52cdb956-b070-4924-8b73-4085c4cd81b5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:31.260304 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-52cdb956-b070-4924-8b73-4085c4cd81b5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:31.266741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-52cdb956-b070-4924-8b73-4085c4cd81b5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:31.267193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-52cdb956-b070-4924-8b73-4085c4cd81b5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:31.267992 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-52cdb956-b070-4924-8b73-4085c4cd81b5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:31.268433 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-52cdb956-b070-4924-8b73-4085c4cd81b5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:31.276648 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-81638d63-bef5-45f1-acb8-c699d14d81ee tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:31.283978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-81638d63-bef5-45f1-acb8-c699d14d81ee tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1668 microversion: 2.1 time: 0.147260 Jun 26 03:10:31.284547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 338/666] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:31 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1668 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:31.396702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-52cdb956-b070-4924-8b73-4085c4cd81b5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:31.404978 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-52cdb956-b070-4924-8b73-4085c4cd81b5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1736 microversion: 2.1 time: 0.149237 Jun 26 03:10:31.405541 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 329/667] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:31 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:10:32.421751 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b341d490-ef3d-461e-acbe-a3d464ebeb69 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:32.422384 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b341d490-ef3d-461e-acbe-a3d464ebeb69 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:32.428963 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b341d490-ef3d-461e-acbe-a3d464ebeb69 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:32.429420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b341d490-ef3d-461e-acbe-a3d464ebeb69 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:32.430224 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b341d490-ef3d-461e-acbe-a3d464ebeb69 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:32.431277 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b341d490-ef3d-461e-acbe-a3d464ebeb69 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:32.557424 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b341d490-ef3d-461e-acbe-a3d464ebeb69 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:32.565262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b341d490-ef3d-461e-acbe-a3d464ebeb69 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1736 microversion: 2.1 time: 0.147362 Jun 26 03:10:32.565820 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 339/668] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:32 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:33.582021 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4a2b8137-953a-48d5-b3be-d80bdcc538f8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:33.582681 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4a2b8137-953a-48d5-b3be-d80bdcc538f8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:33.589178 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4a2b8137-953a-48d5-b3be-d80bdcc538f8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:33.589631 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4a2b8137-953a-48d5-b3be-d80bdcc538f8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:33.590423 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4a2b8137-953a-48d5-b3be-d80bdcc538f8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:33.590862 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4a2b8137-953a-48d5-b3be-d80bdcc538f8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:33.718798 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4a2b8137-953a-48d5-b3be-d80bdcc538f8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:33.726666 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4a2b8137-953a-48d5-b3be-d80bdcc538f8 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1736 microversion: 2.1 time: 0.148504 Jun 26 03:10:33.727715 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 330/669] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:33 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:34.743910 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c28c774e-bf02-40e2-a069-6cf2b854ea92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:34.744480 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c28c774e-bf02-40e2-a069-6cf2b854ea92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:34.751007 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c28c774e-bf02-40e2-a069-6cf2b854ea92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:34.751463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c28c774e-bf02-40e2-a069-6cf2b854ea92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:34.752225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c28c774e-bf02-40e2-a069-6cf2b854ea92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:34.752668 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c28c774e-bf02-40e2-a069-6cf2b854ea92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:34.886761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c28c774e-bf02-40e2-a069-6cf2b854ea92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:34.894534 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c28c774e-bf02-40e2-a069-6cf2b854ea92 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1736 microversion: 2.1 time: 0.154568 Jun 26 03:10:34.895093 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 340/670] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:34 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:35.911521 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8f51ed38-cd29-4549-993f-969e1d8c6743 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:35.912129 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8f51ed38-cd29-4549-993f-969e1d8c6743 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:35.919240 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8f51ed38-cd29-4549-993f-969e1d8c6743 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:35.919693 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8f51ed38-cd29-4549-993f-969e1d8c6743 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:35.920455 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8f51ed38-cd29-4549-993f-969e1d8c6743 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:35.920898 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8f51ed38-cd29-4549-993f-969e1d8c6743 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:36.046398 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8f51ed38-cd29-4549-993f-969e1d8c6743 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:36.054163 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8f51ed38-cd29-4549-993f-969e1d8c6743 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1736 microversion: 2.1 time: 0.146480 Jun 26 03:10:36.054728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 331/671] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:35 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:37.071075 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0a8c0a20-e8d4-4c32-99c0-7da8db3f22bd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:37.071680 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0a8c0a20-e8d4-4c32-99c0-7da8db3f22bd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:37.078167 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0a8c0a20-e8d4-4c32-99c0-7da8db3f22bd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:37.078618 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0a8c0a20-e8d4-4c32-99c0-7da8db3f22bd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:37.079371 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0a8c0a20-e8d4-4c32-99c0-7da8db3f22bd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:37.079805 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0a8c0a20-e8d4-4c32-99c0-7da8db3f22bd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:37.205026 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0a8c0a20-e8d4-4c32-99c0-7da8db3f22bd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:37.213438 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0a8c0a20-e8d4-4c32-99c0-7da8db3f22bd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1736 microversion: 2.1 time: 0.146203 Jun 26 03:10:37.214016 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 341/672] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:37 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:38.230785 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a18dc6ea-7797-4e49-8dee-f05bc5afbc37 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:38.231426 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a18dc6ea-7797-4e49-8dee-f05bc5afbc37 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:38.237850 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a18dc6ea-7797-4e49-8dee-f05bc5afbc37 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:38.238338 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a18dc6ea-7797-4e49-8dee-f05bc5afbc37 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:38.239120 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a18dc6ea-7797-4e49-8dee-f05bc5afbc37 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:38.239559 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a18dc6ea-7797-4e49-8dee-f05bc5afbc37 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:38.369002 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a18dc6ea-7797-4e49-8dee-f05bc5afbc37 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:38.381557 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a18dc6ea-7797-4e49-8dee-f05bc5afbc37 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1736 microversion: 2.1 time: 0.155253 Jun 26 03:10:38.382159 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 332/673] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:38 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:39.398797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-cb582ec7-7edb-4339-a7ec-12bfa0b43396 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:39.399897 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-cb582ec7-7edb-4339-a7ec-12bfa0b43396 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:39.406547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cb582ec7-7edb-4339-a7ec-12bfa0b43396 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:39.407029 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cb582ec7-7edb-4339-a7ec-12bfa0b43396 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:39.407801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cb582ec7-7edb-4339-a7ec-12bfa0b43396 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:39.408240 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cb582ec7-7edb-4339-a7ec-12bfa0b43396 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:39.538928 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-cb582ec7-7edb-4339-a7ec-12bfa0b43396 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:39.547351 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-cb582ec7-7edb-4339-a7ec-12bfa0b43396 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1716 microversion: 2.1 time: 0.152406 Jun 26 03:10:39.547920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 342/674] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:39 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:39.647951 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d4c35ab8-2f3a-4277-9e88-00147efbda38 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:39.648452 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d4c35ab8-2f3a-4277-9e88-00147efbda38 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:39.655567 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4c35ab8-2f3a-4277-9e88-00147efbda38 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:39.655956 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4c35ab8-2f3a-4277-9e88-00147efbda38 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:39.656713 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4c35ab8-2f3a-4277-9e88-00147efbda38 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:39.657152 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d4c35ab8-2f3a-4277-9e88-00147efbda38 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:39.735232 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-d4c35ab8-2f3a-4277-9e88-00147efbda38 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] HTTP exception thrown: Cannot 'detach_volume' instance 473e061c-b6d3-4dff-9171-45f7acfaffee while it is in vm_state rescued Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d4c35ab8-2f3a-4277-9e88-00147efbda38 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Request method failure captured: Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: DELETE /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-volume_attachments/20c918cc-3f6e-49aa-a1dc-3810fee01984 HTTP/1.1 Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zSuaVI5xGBKyt-ni0Q6VRanK0970QIQANht8SFYhxu6bIsUY6Gf98v9efGuB4_m7etgpFVQIiRT1YM4ymg0wjUqIXRNUniyVH783p5_8w9vV_EaiXGuCuSGWlSvG2V2PJ3CS0fR7hmPpRLXSI43DBw5gTc8Hdnlc6J3Fo1C2_HlFs Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: aa1dff9e9be549308ec0ad3a13810062 Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:10:39.737154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:10:39.738750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa1dff9e9be549308ec0ad3a13810062"}]}] Jun 26 03:10:39.738750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:10:39.738750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: aa1dff9e9be549308ec0ad3a13810062 Jun 26 03:10:39.738750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:10:39.738750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-ServerRescueNegativeTestJSON-1294839629-project Jun 26 03:10:39.738750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:10:39.738750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:10:39.738750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: a1313e0937b842059f1e01480c98351c Jun 26 03:10:39.738750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1294839629-project Jun 26 03:10:39.738750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:10:39.738750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Cannot 'detach_volume' instance 473e061c-b6d3-4dff-9171-45f7acfaffee while it is in vm_state rescued Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'server_id': '473e061c-b6d3-4dff-9171-45f7acfaffee', 'id': '20c918cc-3f6e-49aa-a1dc-3810fee01984'} Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 473e061c-b6d3-4dff-9171-45f7acfaffee in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:10:39.739525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 473e061c-b6d3-4dff-9171-45f7acfaffee while it is in vm_state rescued Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 473e061c-b6d3-4dff-9171-45f7acfaffee while it is in vm_state rescued Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:39.740759 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d4c35ab8-2f3a-4277-9e88-00147efbda38 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Returning 409 to user: Cannot 'detach_volume' instance 473e061c-b6d3-4dff-9171-45f7acfaffee while it is in vm_state rescued {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:10:39.741741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d4c35ab8-2f3a-4277-9e88-00147efbda38 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "DELETE /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-volume_attachments/20c918cc-3f6e-49aa-a1dc-3810fee01984" status: 409 len: 152 microversion: 2.1 time: 0.094594 Jun 26 03:10:39.741741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 333/675] 10.222.0.13 () {58 vars in 1415 bytes} [Sun Jun 26 03:10:39 2022] DELETE /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-volume_attachments/20c918cc-3f6e-49aa-a1dc-3810fee01984 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 26 03:10:39.747341 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e3f62463-2c99-4bb0-a795-3d4578fb2000 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:39.747871 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e3f62463-2c99-4bb0-a795-3d4578fb2000 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:39.754217 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e3f62463-2c99-4bb0-a795-3d4578fb2000 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:39.754870 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e3f62463-2c99-4bb0-a795-3d4578fb2000 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:39.755673 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e3f62463-2c99-4bb0-a795-3d4578fb2000 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:39.756117 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e3f62463-2c99-4bb0-a795-3d4578fb2000 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:39.818776 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e3f62463-2c99-4bb0-a795-3d4578fb2000 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "POST /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/action" status: 202 len: 0 microversion: 2.1 time: 0.075060 Jun 26 03:10:39.819435 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 343/676] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:10:39 2022] POST /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:10:39.827833 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5c65ba9c-78fe-4dcb-adb1-c01afdafd822 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:39.828454 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5c65ba9c-78fe-4dcb-adb1-c01afdafd822 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:39.835667 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5c65ba9c-78fe-4dcb-adb1-c01afdafd822 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:39.836411 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5c65ba9c-78fe-4dcb-adb1-c01afdafd822 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:39.837882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5c65ba9c-78fe-4dcb-adb1-c01afdafd822 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:39.838360 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5c65ba9c-78fe-4dcb-adb1-c01afdafd822 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:40.056260 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5c65ba9c-78fe-4dcb-adb1-c01afdafd822 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:40.064282 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5c65ba9c-78fe-4dcb-adb1-c01afdafd822 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1724 microversion: 2.1 time: 0.240202 Jun 26 03:10:40.064854 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 334/677] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:39 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:40.679672 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-17068fb8-71aa-497b-81de-ef168697704e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:40.680828 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-17068fb8-71aa-497b-81de-ef168697704e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:40.687192 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17068fb8-71aa-497b-81de-ef168697704e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:40.687642 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17068fb8-71aa-497b-81de-ef168697704e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:40.688486 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17068fb8-71aa-497b-81de-ef168697704e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:40.688970 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17068fb8-71aa-497b-81de-ef168697704e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:40.711831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-17068fb8-71aa-497b-81de-ef168697704e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7/ips" status: 200 len: 149 microversion: 2.1 time: 0.193543 Jun 26 03:10:40.712373 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 344/678] 10.222.0.13 () {58 vars in 1247 bytes} [Sun Jun 26 03:10:40 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7/ips => generated 149 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:10:40.724284 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f10a1bec-a6fd-4a44-a3d4-0c762631ce76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc863443-bb62-4d8c-af57-0571ba9c7534"}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:40.725393 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f10a1bec-a6fd-4a44-a3d4-0c762631ce76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:40.732219 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f10a1bec-a6fd-4a44-a3d4-0c762631ce76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:40.732665 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f10a1bec-a6fd-4a44-a3d4-0c762631ce76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:40.733415 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f10a1bec-a6fd-4a44-a3d4-0c762631ce76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:40.733851 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f10a1bec-a6fd-4a44-a3d4-0c762631ce76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:40.812537 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-f10a1bec-a6fd-4a44-a3d4-0c762631ce76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Invalid volume: volume cc863443-bb62-4d8c-af57-0571ba9c7534 is already attached to instances: d87611df-64cb-42cb-b734-782bf9ebb9ab Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f10a1bec-a6fd-4a44-a3d4-0c762631ce76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: POST /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7/os-volume_attachments HTTP/1.1 Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 74 Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:10:40.814526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:10:40.816069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:10:40.816069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:10:40.816069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:10:40.816069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:10:40.816069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:10:40.816069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:10:40.816069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:10:40.816069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:10:40.816069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:10:40.816069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Jun 26 03:10:40.816069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {"volumeAttachment": {"volumeId": "cc863443-bb62-4d8c-af57-0571ba9c7534"}} Jun 26 03:10:40.816069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Invalid volume: volume cc863443-bb62-4d8c-af57-0571ba9c7534 is already attached to instances: d87611df-64cb-42cb-b734-782bf9ebb9ab Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'server_id': '3c4e7b87-db95-47e8-8679-3a36a89d75f7', 'body': {'volumeAttachment': {'volumeId': 'cc863443-bb62-4d8c-af57-0571ba9c7534'}}} Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cc863443-bb62-4d8c-af57-0571ba9c7534 is already attached to instances: d87611df-64cb-42cb-b734-782bf9ebb9ab Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:40.816882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cc863443-bb62-4d8c-af57-0571ba9c7534 is already attached to instances: d87611df-64cb-42cb-b734-782bf9ebb9ab Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:40.818382 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:10:40.819852 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:10:40.819852 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:10:40.819852 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:10:40.819852 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cc863443-bb62-4d8c-af57-0571ba9c7534 is already attached to instances: d87611df-64cb-42cb-b734-782bf9ebb9ab Jun 26 03:10:40.819852 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:40.819852 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f10a1bec-a6fd-4a44-a3d4-0c762631ce76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 400 to user: Invalid volume: volume cc863443-bb62-4d8c-af57-0571ba9c7534 is already attached to instances: d87611df-64cb-42cb-b734-782bf9ebb9ab {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:10:40.819852 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f10a1bec-a6fd-4a44-a3d4-0c762631ce76 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "POST /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096759 Jun 26 03:10:40.819852 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 335/679] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:10:40 2022] POST /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 26 03:10:40.825605 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e220a761-19a8-41b4-ae54-9943820a08b6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:40.826144 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e220a761-19a8-41b4-ae54-9943820a08b6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:40.832052 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e220a761-19a8-41b4-ae54-9943820a08b6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:40.832501 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e220a761-19a8-41b4-ae54-9943820a08b6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:40.833260 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e220a761-19a8-41b4-ae54-9943820a08b6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:40.833695 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e220a761-19a8-41b4-ae54-9943820a08b6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:40.858702 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e220a761-19a8-41b4-ae54-9943820a08b6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:10:40.884810 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:10:40.931998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e220a761-19a8-41b4-ae54-9943820a08b6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 204 len: 0 microversion: 2.1 time: 0.109879 Jun 26 03:10:40.932575 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 345/680] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:10:40 2022] DELETE /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:10:40.940542 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-aafa14b7-021b-4bcb-9189-70502124e39e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:40.941159 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-aafa14b7-021b-4bcb-9189-70502124e39e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:40.947816 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aafa14b7-021b-4bcb-9189-70502124e39e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:40.948274 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aafa14b7-021b-4bcb-9189-70502124e39e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:40.949040 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aafa14b7-021b-4bcb-9189-70502124e39e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:40.949486 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aafa14b7-021b-4bcb-9189-70502124e39e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:41.079213 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-aafa14b7-021b-4bcb-9189-70502124e39e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:41.081509 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:10:41.082656 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-06cbf8e6-f615-45b4-91c4-6d232d1bff3a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:41.083484 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-06cbf8e6-f615-45b4-91c4-6d232d1bff3a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:41.088690 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-aafa14b7-021b-4bcb-9189-70502124e39e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1681 microversion: 2.1 time: 0.151881 Jun 26 03:10:41.089262 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 336/681] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:40 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:41.090743 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-06cbf8e6-f615-45b4-91c4-6d232d1bff3a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:41.091247 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-06cbf8e6-f615-45b4-91c4-6d232d1bff3a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:41.092014 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-06cbf8e6-f615-45b4-91c4-6d232d1bff3a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:41.092446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-06cbf8e6-f615-45b4-91c4-6d232d1bff3a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:41.217187 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-06cbf8e6-f615-45b4-91c4-6d232d1bff3a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:41.224969 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-06cbf8e6-f615-45b4-91c4-6d232d1bff3a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1724 microversion: 2.1 time: 0.146454 Jun 26 03:10:41.225537 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 346/682] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:41 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:10:42.106876 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5ca017df-f432-4535-a8c5-468658df341e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:42.107394 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5ca017df-f432-4535-a8c5-468658df341e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:42.114857 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5ca017df-f432-4535-a8c5-468658df341e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:42.115310 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5ca017df-f432-4535-a8c5-468658df341e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:42.116069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5ca017df-f432-4535-a8c5-468658df341e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:42.116506 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5ca017df-f432-4535-a8c5-468658df341e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:42.242562 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-57bb2932-d890-4666-aac5-f8edfe6c3fe6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:42.243702 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-57bb2932-d890-4666-aac5-f8edfe6c3fe6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:42.250061 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-57bb2932-d890-4666-aac5-f8edfe6c3fe6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:42.250518 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-57bb2932-d890-4666-aac5-f8edfe6c3fe6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:42.251325 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-57bb2932-d890-4666-aac5-f8edfe6c3fe6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:42.251885 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-57bb2932-d890-4666-aac5-f8edfe6c3fe6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:42.265114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5ca017df-f432-4535-a8c5-468658df341e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:42.272491 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5ca017df-f432-4535-a8c5-468658df341e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1681 microversion: 2.1 time: 0.170577 Jun 26 03:10:42.273063 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 337/683] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:42 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:42.379775 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-57bb2932-d890-4666-aac5-f8edfe6c3fe6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:42.387606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-57bb2932-d890-4666-aac5-f8edfe6c3fe6 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1724 microversion: 2.1 time: 0.148982 Jun 26 03:10:42.388170 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 347/684] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:42 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:10:43.289146 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c539fb1a-7471-44d4-ac24-50e1ba39ee89 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:43.289758 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c539fb1a-7471-44d4-ac24-50e1ba39ee89 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:43.296110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c539fb1a-7471-44d4-ac24-50e1ba39ee89 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:43.296556 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c539fb1a-7471-44d4-ac24-50e1ba39ee89 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:43.297311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c539fb1a-7471-44d4-ac24-50e1ba39ee89 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:43.297745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c539fb1a-7471-44d4-ac24-50e1ba39ee89 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:43.404722 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ea2f69f5-228b-481d-a799-723d1a55132e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:43.405335 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ea2f69f5-228b-481d-a799-723d1a55132e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:43.412997 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ea2f69f5-228b-481d-a799-723d1a55132e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:43.413781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ea2f69f5-228b-481d-a799-723d1a55132e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:43.415146 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ea2f69f5-228b-481d-a799-723d1a55132e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:43.415897 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ea2f69f5-228b-481d-a799-723d1a55132e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:43.429940 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c539fb1a-7471-44d4-ac24-50e1ba39ee89 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:43.437990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c539fb1a-7471-44d4-ac24-50e1ba39ee89 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1681 microversion: 2.1 time: 0.152953 Jun 26 03:10:43.438583 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 338/685] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:43 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:43.549093 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ea2f69f5-228b-481d-a799-723d1a55132e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:43.557629 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ea2f69f5-228b-481d-a799-723d1a55132e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1724 microversion: 2.1 time: 0.156821 Jun 26 03:10:43.558227 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 348/686] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:43 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:10:44.455699 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-409a09c6-d8f0-4002-afa5-248ffb40a89c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:44.456305 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-409a09c6-d8f0-4002-afa5-248ffb40a89c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:44.463033 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-409a09c6-d8f0-4002-afa5-248ffb40a89c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:44.463477 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-409a09c6-d8f0-4002-afa5-248ffb40a89c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:44.464289 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-409a09c6-d8f0-4002-afa5-248ffb40a89c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:44.464721 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-409a09c6-d8f0-4002-afa5-248ffb40a89c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:44.574897 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e092a94e-eeb7-4680-be98-645f5923c581 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:44.575611 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e092a94e-eeb7-4680-be98-645f5923c581 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:44.581885 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e092a94e-eeb7-4680-be98-645f5923c581 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:44.582362 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e092a94e-eeb7-4680-be98-645f5923c581 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:44.583129 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e092a94e-eeb7-4680-be98-645f5923c581 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:44.583563 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e092a94e-eeb7-4680-be98-645f5923c581 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:44.594855 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-409a09c6-d8f0-4002-afa5-248ffb40a89c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:44.602339 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-409a09c6-d8f0-4002-afa5-248ffb40a89c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1681 microversion: 2.1 time: 0.150665 Jun 26 03:10:44.602912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 339/687] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:44 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:44.716974 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e092a94e-eeb7-4680-be98-645f5923c581 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:44.724718 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e092a94e-eeb7-4680-be98-645f5923c581 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1730 microversion: 2.1 time: 0.154105 Jun 26 03:10:44.725283 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 349/688] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:44 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:10:44.740795 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a728dec0-92d1-4a90-89de-116316008189 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:44.741291 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a728dec0-92d1-4a90-89de-116316008189 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:44.747721 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a728dec0-92d1-4a90-89de-116316008189 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:44.748198 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a728dec0-92d1-4a90-89de-116316008189 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:44.748955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a728dec0-92d1-4a90-89de-116316008189 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:44.749420 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a728dec0-92d1-4a90-89de-116316008189 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:44.835262 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a728dec0-92d1-4a90-89de-116316008189 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098345 Jun 26 03:10:44.835846 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 340/689] 10.222.0.13 () {58 vars in 1274 bytes} [Sun Jun 26 03:10:44 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:10:45.619755 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1af10555-30b6-484f-bbb4-8082b6cffbd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:45.620376 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1af10555-30b6-484f-bbb4-8082b6cffbd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:45.626996 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1af10555-30b6-484f-bbb4-8082b6cffbd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:45.627795 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1af10555-30b6-484f-bbb4-8082b6cffbd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:45.629354 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1af10555-30b6-484f-bbb4-8082b6cffbd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:45.630064 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1af10555-30b6-484f-bbb4-8082b6cffbd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:46.022109 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-0a4ab4b6-2241-441a-ae7e-fe685d1f5457 req-b99a24cb-7cdf-492e-a72f-4c4479821683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473e061c-b6d3-4dff-9171-45f7acfaffee", "tag": "9ffa489f-38cb-4f25-9eb2-e940343d2383"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:46.030801 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-0a4ab4b6-2241-441a-ae7e-fe685d1f5457 req-b99a24cb-7cdf-492e-a72f-4c4479821683 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:46.031345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-0a4ab4b6-2241-441a-ae7e-fe685d1f5457 req-b99a24cb-7cdf-492e-a72f-4c4479821683 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:46.043727 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-0a4ab4b6-2241-441a-ae7e-fe685d1f5457 req-b99a24cb-7cdf-492e-a72f-4c4479821683 service nova] Creating event network-changed:9ffa489f-38cb-4f25-9eb2-e940343d2383 for instance 473e061c-b6d3-4dff-9171-45f7acfaffee on hv-cinder-84684 Jun 26 03:10:46.049189 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-0a4ab4b6-2241-441a-ae7e-fe685d1f5457 req-b99a24cb-7cdf-492e-a72f-4c4479821683 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099298 Jun 26 03:10:46.050650 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 341/690] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:10:46.076981 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1af10555-30b6-484f-bbb4-8082b6cffbd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:46.085686 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1af10555-30b6-484f-bbb4-8082b6cffbd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1681 microversion: 2.1 time: 0.469755 Jun 26 03:10:46.087591 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 350/691] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:45 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1681 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:47.003444 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-945a289c-f415-48a8-bfdd-2a61eae38427 req-5d55a636-3868-4dc8-a286-646743223f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4e7b87-db95-47e8-8679-3a36a89d75f7", "name": "network-vif-deleted", "tag": "5b9b80b1-5c7f-45d8-944b-ab893c926663"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:47.013896 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-945a289c-f415-48a8-bfdd-2a61eae38427 req-5d55a636-3868-4dc8-a286-646743223f54 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:47.014374 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-945a289c-f415-48a8-bfdd-2a61eae38427 req-5d55a636-3868-4dc8-a286-646743223f54 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:47.036026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-945a289c-f415-48a8-bfdd-2a61eae38427 req-5d55a636-3868-4dc8-a286-646743223f54 service nova] Creating event network-vif-deleted:5b9b80b1-5c7f-45d8-944b-ab893c926663 for instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 on hv-cinder-84684 Jun 26 03:10:47.047518 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-945a289c-f415-48a8-bfdd-2a61eae38427 req-5d55a636-3868-4dc8-a286-646743223f54 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104187 Jun 26 03:10:47.053461 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 342/692] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:10:47.104836 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e600440a-37c6-413d-81b0-58a4b56b6275 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:47.105584 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e600440a-37c6-413d-81b0-58a4b56b6275 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:47.112089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e600440a-37c6-413d-81b0-58a4b56b6275 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:47.112552 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e600440a-37c6-413d-81b0-58a4b56b6275 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:47.113332 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e600440a-37c6-413d-81b0-58a4b56b6275 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:47.113774 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e600440a-37c6-413d-81b0-58a4b56b6275 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:47.199307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e600440a-37c6-413d-81b0-58a4b56b6275 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:47.207445 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e600440a-37c6-413d-81b0-58a4b56b6275 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 200 len: 1326 microversion: 2.1 time: 0.107151 Jun 26 03:10:47.217485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 351/693] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:47 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 1326 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:48.065520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-637d7532-3973-47e9-87e6-d267d73582b8 req-e58dcf0c-a184-4522-8309-77b241379d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473e061c-b6d3-4dff-9171-45f7acfaffee", "tag": "9ffa489f-38cb-4f25-9eb2-e940343d2383"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:48.074298 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-637d7532-3973-47e9-87e6-d267d73582b8 req-e58dcf0c-a184-4522-8309-77b241379d25 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:48.074744 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-637d7532-3973-47e9-87e6-d267d73582b8 req-e58dcf0c-a184-4522-8309-77b241379d25 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:48.087286 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-637d7532-3973-47e9-87e6-d267d73582b8 req-e58dcf0c-a184-4522-8309-77b241379d25 service nova] Creating event network-changed:9ffa489f-38cb-4f25-9eb2-e940343d2383 for instance 473e061c-b6d3-4dff-9171-45f7acfaffee on hv-cinder-84684 Jun 26 03:10:48.092168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-637d7532-3973-47e9-87e6-d267d73582b8 req-e58dcf0c-a184-4522-8309-77b241379d25 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030480 Jun 26 03:10:48.093052 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 343/694] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:10:48.225025 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0974a90b-74ac-4e1e-85b8-5741ac03ff91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:48.225901 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0974a90b-74ac-4e1e-85b8-5741ac03ff91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:48.234386 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0974a90b-74ac-4e1e-85b8-5741ac03ff91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:48.234985 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0974a90b-74ac-4e1e-85b8-5741ac03ff91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:48.235962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0974a90b-74ac-4e1e-85b8-5741ac03ff91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:48.236492 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0974a90b-74ac-4e1e-85b8-5741ac03ff91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:48.251963 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-0974a90b-74ac-4e1e-85b8-5741ac03ff91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0974a90b-74ac-4e1e-85b8-5741ac03ff91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 HTTP/1.1 Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:10:48.254032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:10:48.255609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:10:48.255609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:10:48.255609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:10:48.255609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:10:48.255609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:10:48.255609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:10:48.255609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:10:48.255609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:10:48.255609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:10:48.255609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:10:48.255609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:10:48.255609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '3c4e7b87-db95-47e8-8679-3a36a89d75f7'} Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:10:48.256519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:10:48.257962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:10:48.260320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0974a90b-74ac-4e1e-85b8-5741ac03ff91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 404 to user: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:10:48.260320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0974a90b-74ac-4e1e-85b8-5741ac03ff91 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 404 len: 111 microversion: 2.1 time: 0.036640 Jun 26 03:10:48.267322 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-219a4766-08d9-4841-818d-44b7d85a468e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '.version_select at 0x7f5827610160>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:48.270505 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 352/695] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:48 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:10:48.291533 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-219a4766-08d9-4841-818d-44b7d85a468e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-382551666" status: 202 len: 0 microversion: 2.1 time: 0.028316 Jun 26 03:10:48.295591 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 344/696] 10.222.0.13 () {58 vars in 1217 bytes} [Sun Jun 26 03:10:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-382551666 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:10:49.122219 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0021d5b5-a320-4257-b708-6e224c8dec90 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:49.122717 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0021d5b5-a320-4257-b708-6e224c8dec90 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:49.128554 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0021d5b5-a320-4257-b708-6e224c8dec90 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:49.129269 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0021d5b5-a320-4257-b708-6e224c8dec90 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:49.130014 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0021d5b5-a320-4257-b708-6e224c8dec90 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:49.130481 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0021d5b5-a320-4257-b708-6e224c8dec90 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:49.209086 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.objects.instance [None req-0021d5b5-a320-4257-b708-6e224c8dec90 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lazy-loading 'services' on Instance uuid d87611df-64cb-42cb-b734-782bf9ebb9ab {{(pid=117783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:10:49.278513 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0021d5b5-a320-4257-b708-6e224c8dec90 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab/os-volume_attachments/cc863443-bb62-4d8c-af57-0571ba9c7534" status: 202 len: 0 microversion: 2.1 time: 0.159939 Jun 26 03:10:49.279136 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 353/697] 10.222.0.13 () {58 vars in 1415 bytes} [Sun Jun 26 03:10:49 2022] DELETE /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab/os-volume_attachments/cc863443-bb62-4d8c-af57-0571ba9c7534 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:10:49.287746 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ac5749e9-3737-4cb8-b1e7-ab605bc1747a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:49.289008 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ac5749e9-3737-4cb8-b1e7-ab605bc1747a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:49.296979 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ac5749e9-3737-4cb8-b1e7-ab605bc1747a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:49.297380 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ac5749e9-3737-4cb8-b1e7-ab605bc1747a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:49.298534 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ac5749e9-3737-4cb8-b1e7-ab605bc1747a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:49.299331 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ac5749e9-3737-4cb8-b1e7-ab605bc1747a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:49.330392 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ac5749e9-3737-4cb8-b1e7-ab605bc1747a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046938 Jun 26 03:10:49.330948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 345/698] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:10:49 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:10:50.342894 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1a5211ac-bc93-4799-bdac-dad01497378a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:50.343999 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1a5211ac-bc93-4799-bdac-dad01497378a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:50.350901 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1a5211ac-bc93-4799-bdac-dad01497378a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:50.351456 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1a5211ac-bc93-4799-bdac-dad01497378a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:50.352318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1a5211ac-bc93-4799-bdac-dad01497378a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:50.352817 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1a5211ac-bc93-4799-bdac-dad01497378a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:50.381049 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1a5211ac-bc93-4799-bdac-dad01497378a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042337 Jun 26 03:10:50.381588 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 354/699] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:10:50 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 26 03:10:50.438154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6a226f3c-2f7c-4433-b1fa-c655b0866762 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:50.438656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-6a226f3c-2f7c-4433-b1fa-c655b0866762 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:50.445343 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6a226f3c-2f7c-4433-b1fa-c655b0866762 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:50.446351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6a226f3c-2f7c-4433-b1fa-c655b0866762 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:50.447124 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6a226f3c-2f7c-4433-b1fa-c655b0866762 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:50.447580 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6a226f3c-2f7c-4433-b1fa-c655b0866762 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:50.473814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-6a226f3c-2f7c-4433-b1fa-c655b0866762 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Going to try to terminate instance {{(pid=117782) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:10:50.555832 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6a226f3c-2f7c-4433-b1fa-c655b0866762 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 204 len: 0 microversion: 2.1 time: 0.120998 Jun 26 03:10:50.556640 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 346/700] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:10:50 2022] DELETE /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:10:50.564562 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-cde30333-f062-4d74-ac1f-df0d96f1deb1 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:50.565256 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-cde30333-f062-4d74-ac1f-df0d96f1deb1 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:50.571768 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cde30333-f062-4d74-ac1f-df0d96f1deb1 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:50.572227 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cde30333-f062-4d74-ac1f-df0d96f1deb1 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:50.572995 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cde30333-f062-4d74-ac1f-df0d96f1deb1 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:50.573436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-cde30333-f062-4d74-ac1f-df0d96f1deb1 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:50.699314 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-cde30333-f062-4d74-ac1f-df0d96f1deb1 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:50.706708 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-cde30333-f062-4d74-ac1f-df0d96f1deb1 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1680 microversion: 2.1 time: 0.145983 Jun 26 03:10:50.707269 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 355/701] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:50 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:10:51.724854 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-32f81ed3-b0e4-40b6-87dc-ba3174612213 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:51.725559 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-32f81ed3-b0e4-40b6-87dc-ba3174612213 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:51.733063 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-32f81ed3-b0e4-40b6-87dc-ba3174612213 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:51.733517 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-32f81ed3-b0e4-40b6-87dc-ba3174612213 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:51.734460 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-32f81ed3-b0e4-40b6-87dc-ba3174612213 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:51.734898 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-32f81ed3-b0e4-40b6-87dc-ba3174612213 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:51.882013 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-32f81ed3-b0e4-40b6-87dc-ba3174612213 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:51.890161 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-32f81ed3-b0e4-40b6-87dc-ba3174612213 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1680 microversion: 2.1 time: 0.169489 Jun 26 03:10:51.890827 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 347/702] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:51 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:52.288071 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b5471eaa-2962-40ce-a62f-a1bc373f1ee9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:52.288578 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b5471eaa-2962-40ce-a62f-a1bc373f1ee9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:52.294787 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b5471eaa-2962-40ce-a62f-a1bc373f1ee9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:52.295239 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b5471eaa-2962-40ce-a62f-a1bc373f1ee9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:52.296009 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b5471eaa-2962-40ce-a62f-a1bc373f1ee9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:52.296446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b5471eaa-2962-40ce-a62f-a1bc373f1ee9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:52.325577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b5471eaa-2962-40ce-a62f-a1bc373f1ee9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/os-volume_attachments/dc221f1c-1250-42d1-aea8-3cf7c40bc0c0" status: 200 len: 194 microversion: 2.20 time: 0.145809 Jun 26 03:10:52.326191 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 356/703] 10.222.0.13 () {60 vars in 1453 bytes} [Sun Jun 26 03:10:52 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/os-volume_attachments/dc221f1c-1250-42d1-aea8-3cf7c40bc0c0 => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 03:10:52.388506 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-11dd574b-4951-4576-8d17-135acd0a5964 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:52.389077 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-11dd574b-4951-4576-8d17-135acd0a5964 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:52.395293 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-11dd574b-4951-4576-8d17-135acd0a5964 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:52.395752 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-11dd574b-4951-4576-8d17-135acd0a5964 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:52.396518 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-11dd574b-4951-4576-8d17-135acd0a5964 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:52.396959 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-11dd574b-4951-4576-8d17-135acd0a5964 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:52.476816 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-11dd574b-4951-4576-8d17-135acd0a5964 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lazy-loading 'services' on Instance uuid 3b0d1d9b-d025-442c-a2f6-db22050d9059 {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:10:52.549689 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-11dd574b-4951-4576-8d17-135acd0a5964 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/os-volume_attachments/dc221f1c-1250-42d1-aea8-3cf7c40bc0c0" status: 202 len: 0 microversion: 2.20 time: 0.165709 Jun 26 03:10:52.554982 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 348/704] 10.222.0.13 () {60 vars in 1456 bytes} [Sun Jun 26 03:10:52 2022] DELETE /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/os-volume_attachments/dc221f1c-1250-42d1-aea8-3cf7c40bc0c0 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:10:52.562762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-087c011b-276b-4651-8676-da18e2aa7d3e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:52.564440 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-087c011b-276b-4651-8676-da18e2aa7d3e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:52.571305 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-087c011b-276b-4651-8676-da18e2aa7d3e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:52.572471 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-087c011b-276b-4651-8676-da18e2aa7d3e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:52.574023 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-087c011b-276b-4651-8676-da18e2aa7d3e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:52.574579 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-087c011b-276b-4651-8676-da18e2aa7d3e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:52.611152 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-087c011b-276b-4651-8676-da18e2aa7d3e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055355 Jun 26 03:10:52.611728 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 357/705] 10.222.0.13 () {60 vars in 1342 bytes} [Sun Jun 26 03:10:52 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 03:10:52.849375 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-649ced35-202b-4721-af24-23a2f20f9be7 req-438acb01-d6ac-49c8-8379-a03f598d36bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87611df-64cb-42cb-b734-782bf9ebb9ab", "name": "network-vif-deleted", "tag": "964b9885-7663-4cc6-bfd4-5bb8f0e20bea"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:52.859006 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-649ced35-202b-4721-af24-23a2f20f9be7 req-438acb01-d6ac-49c8-8379-a03f598d36bb service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:52.859457 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-649ced35-202b-4721-af24-23a2f20f9be7 req-438acb01-d6ac-49c8-8379-a03f598d36bb service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:52.871158 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-649ced35-202b-4721-af24-23a2f20f9be7 req-438acb01-d6ac-49c8-8379-a03f598d36bb service nova] Creating event network-vif-deleted:964b9885-7663-4cc6-bfd4-5bb8f0e20bea for instance d87611df-64cb-42cb-b734-782bf9ebb9ab on hv-cinder-84684 Jun 26 03:10:52.876075 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-649ced35-202b-4721-af24-23a2f20f9be7 req-438acb01-d6ac-49c8-8379-a03f598d36bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030798 Jun 26 03:10:52.876677 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 349/706] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:10:52.907861 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-895250d4-73c8-4d78-944f-142e41ebc3ce tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:52.908483 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-895250d4-73c8-4d78-944f-142e41ebc3ce tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:52.914911 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-895250d4-73c8-4d78-944f-142e41ebc3ce tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:52.915845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-895250d4-73c8-4d78-944f-142e41ebc3ce tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:52.916629 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-895250d4-73c8-4d78-944f-142e41ebc3ce tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:52.917068 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-895250d4-73c8-4d78-944f-142e41ebc3ce tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:52.981159 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-895250d4-73c8-4d78-944f-142e41ebc3ce tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:52.989042 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-895250d4-73c8-4d78-944f-142e41ebc3ce tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 200 len: 1613 microversion: 2.1 time: 0.085060 Jun 26 03:10:52.999219 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 358/707] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:52 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:53.625109 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3aa1f8b2-40ab-47e6-91af-a04a00e9e821 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:53.626158 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3aa1f8b2-40ab-47e6-91af-a04a00e9e821 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:53.628171 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:10:53.634688 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3aa1f8b2-40ab-47e6-91af-a04a00e9e821 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:53.635154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3aa1f8b2-40ab-47e6-91af-a04a00e9e821 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:53.636092 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3aa1f8b2-40ab-47e6-91af-a04a00e9e821 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:53.636400 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3aa1f8b2-40ab-47e6-91af-a04a00e9e821 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:53.671757 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3aa1f8b2-40ab-47e6-91af-a04a00e9e821 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050899 Jun 26 03:10:53.672571 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 350/708] 10.222.0.13 () {60 vars in 1342 bytes} [Sun Jun 26 03:10:53 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:53.736355 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-942047a6-9faf-4bf2-a104-d88afa77ddd0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:53.736990 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-942047a6-9faf-4bf2-a104-d88afa77ddd0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:53.746598 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-942047a6-9faf-4bf2-a104-d88afa77ddd0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:53.747440 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-942047a6-9faf-4bf2-a104-d88afa77ddd0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:53.748451 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-942047a6-9faf-4bf2-a104-d88afa77ddd0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:53.748993 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-942047a6-9faf-4bf2-a104-d88afa77ddd0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:53.777713 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-942047a6-9faf-4bf2-a104-d88afa77ddd0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:10:53.831618 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:10:53.861230 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-942047a6-9faf-4bf2-a104-d88afa77ddd0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 204 len: 0 microversion: 2.20 time: 0.128561 Jun 26 03:10:53.863109 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 359/709] 10.222.0.13 () {60 vars in 1279 bytes} [Sun Jun 26 03:10:53 2022] DELETE /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 26 03:10:53.872028 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-17005c13-da61-4a33-99b7-71be84222cf1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:53.872817 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-17005c13-da61-4a33-99b7-71be84222cf1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:53.879896 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-17005c13-da61-4a33-99b7-71be84222cf1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:53.880438 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-17005c13-da61-4a33-99b7-71be84222cf1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:53.881292 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-17005c13-da61-4a33-99b7-71be84222cf1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:53.881819 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-17005c13-da61-4a33-99b7-71be84222cf1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:54.007767 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8c225e20-b9db-40f1-9c41-6acb0e2a2d6d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:54.008595 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8c225e20-b9db-40f1-9c41-6acb0e2a2d6d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:54.014582 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-17005c13-da61-4a33-99b7-71be84222cf1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:54.015554 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8c225e20-b9db-40f1-9c41-6acb0e2a2d6d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:54.016098 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8c225e20-b9db-40f1-9c41-6acb0e2a2d6d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:54.016943 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8c225e20-b9db-40f1-9c41-6acb0e2a2d6d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:54.017457 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8c225e20-b9db-40f1-9c41-6acb0e2a2d6d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:54.022661 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-17005c13-da61-4a33-99b7-71be84222cf1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:54.024150 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-17005c13-da61-4a33-99b7-71be84222cf1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:54.025298 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-17005c13-da61-4a33-99b7-71be84222cf1 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.157812 Jun 26 03:10:54.025856 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 351/710] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:10:53 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:10:54.030945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-8c225e20-b9db-40f1-9c41-6acb0e2a2d6d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8c225e20-b9db-40f1-9c41-6acb0e2a2d6d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab HTTP/1.1 Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:10:54.032577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:10:54.034145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:10:54.034145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:10:54.034145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:10:54.034145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:10:54.034145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:10:54.034145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:10:54.034145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:10:54.034145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:10:54.034145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:10:54.034145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:10:54.034145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:10:54.034145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': 'd87611df-64cb-42cb-b734-782bf9ebb9ab'} Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:10:54.034945 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:10:54.036180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:10:54.037210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8c225e20-b9db-40f1-9c41-6acb0e2a2d6d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 404 to user: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:10:54.037210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8c225e20-b9db-40f1-9c41-6acb0e2a2d6d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 404 len: 111 microversion: 2.1 time: 0.030752 Jun 26 03:10:54.037210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 360/711] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:54 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 26 03:10:54.042404 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c9f01ee6-46a3-4c4e-b74a-fe749c2f39c4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '.version_select at 0x7f5827610280>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:54.059751 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c9f01ee6-46a3-4c4e-b74a-fe749c2f39c4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-919588260" status: 202 len: 0 microversion: 2.1 time: 0.020766 Jun 26 03:10:54.060313 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 352/712] 10.222.0.13 () {58 vars in 1217 bytes} [Sun Jun 26 03:10:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-919588260 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 26 03:10:54.682847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d69cdbd2-2792-422d-9e6f-c9454a930ca0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Action: 'create', calling method: .version_select at 0x7f5827713ca0>, body: {"keypair": {"name": "tempest-keypair-1693663904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV/zbSvdioGpCjCOxRf0QSAfZEYfOgtFAKj6kQ4uWgOT/G2LJSCcZON3MS2WCGv9lIdL9iTp2/D4pipAUB4tXyVCR1y0O5ERD42V19bA4sJo8BwbvDux2PrmUXUWqpKYw=="}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:54.696586 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-d69cdbd2-2792-422d-9e6f-c9454a930ca0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for project 1850f9f425294a82add8a09690dc1df0. Resources: {'key_pairs'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:10:54.700370 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-d69cdbd2-2792-422d-9e6f-c9454a930ca0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for user 3b7a90ca5e374fc882b644e34e0a3015 and project 1850f9f425294a82add8a09690dc1df0. Resources: {'key_pairs'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:10:54.724120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d69cdbd2-2792-422d-9e6f-c9454a930ca0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045824 Jun 26 03:10:54.724698 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 361/713] 10.222.0.13 () {60 vars in 1158 bytes} [Sun Jun 26 03:10:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:10:55.044269 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-11a7139a-d8a0-45eb-923e-0baff9f83a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:55.044873 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-11a7139a-d8a0-45eb-923e-0baff9f83a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:55.051291 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-11a7139a-d8a0-45eb-923e-0baff9f83a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:55.051746 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-11a7139a-d8a0-45eb-923e-0baff9f83a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:55.052509 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-11a7139a-d8a0-45eb-923e-0baff9f83a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:55.052950 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-11a7139a-d8a0-45eb-923e-0baff9f83a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:55.185786 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-11a7139a-d8a0-45eb-923e-0baff9f83a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:55.194018 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-11a7139a-d8a0-45eb-923e-0baff9f83a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:55.195535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-11a7139a-d8a0-45eb-923e-0baff9f83a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:55.197181 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-11a7139a-d8a0-45eb-923e-0baff9f83a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.157420 Jun 26 03:10:55.197737 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 353/714] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:10:55 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:10:55.912335 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2142011786", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02cd0f74-99cd-4eb9-aeb7-aae2b7255a50"}], "security_groups": [{"name": "tempest-securitygroup--1916119350"}], "key_name": "tempest-keypair-1693663904", "user_data": "}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:55.920228 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:10:56.020782 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] validate_networks() for [('02cd0f74-99cd-4eb9-aeb7-aae2b7255a50', None, None, None, None, None)] {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:10:56.215406 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b6245b25-9bdf-4879-8c6e-b0ae57b38198 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:56.216151 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b6245b25-9bdf-4879-8c6e-b0ae57b38198 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:56.222862 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b6245b25-9bdf-4879-8c6e-b0ae57b38198 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:56.223590 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b6245b25-9bdf-4879-8c6e-b0ae57b38198 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:56.224373 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b6245b25-9bdf-4879-8c6e-b0ae57b38198 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:56.224819 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b6245b25-9bdf-4879-8c6e-b0ae57b38198 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:56.425861 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b6245b25-9bdf-4879-8c6e-b0ae57b38198 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:56.433952 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b6245b25-9bdf-4879-8c6e-b0ae57b38198 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:56.435765 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b6245b25-9bdf-4879-8c6e-b0ae57b38198 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:56.437074 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b6245b25-9bdf-4879-8c6e-b0ae57b38198 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 200 len: 1724 microversion: 2.20 time: 0.226089 Jun 26 03:10:56.437635 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 354/715] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:10:56 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:10:56.544799 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:10:56.545219 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:10:56.545701 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:10:56.546422 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:10:56.546839 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:10:56.555997 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:56.556443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:56.557230 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:56.557665 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:56.574105 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for project 1850f9f425294a82add8a09690dc1df0. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:10:56.578319 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for user 3b7a90ca5e374fc882b644e34e0a3015 and project 1850f9f425294a82add8a09690dc1df0. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:10:56.589786 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:10:56.592089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:10:56.640139 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e54174aa-ea9f-47b0-a568-28e432edb7e0 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.732556 Jun 26 03:10:56.641281 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 362/716] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:10:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:10:56.651769 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a1b693e3-63f1-4120-af75-c879d351c216 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:56.653047 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a1b693e3-63f1-4120-af75-c879d351c216 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:56.707808 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a1b693e3-63f1-4120-af75-c879d351c216 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:56.715088 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a1b693e3-63f1-4120-af75-c879d351c216 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1242 microversion: 2.1 time: 0.068006 Jun 26 03:10:56.715667 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 355/717] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:56 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:56.750373 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-8efed4cc-3fd2-41cb-ad0a-89cac9395660 req-0f5bf99f-9bec-4e6f-9795-450f7b570762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0d1d9b-d025-442c-a2f6-db22050d9059", "name": "network-vif-deleted", "tag": "52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:56.760969 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-8efed4cc-3fd2-41cb-ad0a-89cac9395660 req-0f5bf99f-9bec-4e6f-9795-450f7b570762 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:56.761769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-8efed4cc-3fd2-41cb-ad0a-89cac9395660 req-0f5bf99f-9bec-4e6f-9795-450f7b570762 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:56.773888 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-8efed4cc-3fd2-41cb-ad0a-89cac9395660 req-0f5bf99f-9bec-4e6f-9795-450f7b570762 service nova] Creating event network-vif-deleted:52fe6654-0bad-4f8c-9c8b-2d810ffaeb4f for instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 on hv-cinder-84684 Jun 26 03:10:56.779938 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-8efed4cc-3fd2-41cb-ad0a-89cac9395660 req-0f5bf99f-9bec-4e6f-9795-450f7b570762 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033152 Jun 26 03:10:56.780780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 363/718] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:10:57.456748 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9f359d26-d1f3-4f18-9f0d-14dc9381ab24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:57.457349 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9f359d26-d1f3-4f18-9f0d-14dc9381ab24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:57.464068 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9f359d26-d1f3-4f18-9f0d-14dc9381ab24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:57.464318 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9f359d26-d1f3-4f18-9f0d-14dc9381ab24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:57.465108 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9f359d26-d1f3-4f18-9f0d-14dc9381ab24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:57.465544 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9f359d26-d1f3-4f18-9f0d-14dc9381ab24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:57.479827 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-9f359d26-d1f3-4f18-9f0d-14dc9381ab24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] HTTP exception thrown: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9f359d26-d1f3-4f18-9f0d-14dc9381ab24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Request method failure captured: Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 HTTP/1.1 Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zKxIvYpxH8cnnfUpzhJ4qrsLEzUUvvIeoHIzze08rDvffyk_6UnMMVldyhnF1WcrcYaqru1vuEypebS29viyK0F3RALZSFYPrqhbldVqfvm9AaAuQswi7MW56GHyQa7vlCkwmOpJg2k1Qt2D7xxpff9vELYIOqKNDsEcSe_B0amHM Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Openstack-Nova-Api-Version: 2.20 Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 5dd1a7a651fa4d27a1b6488ca13effca Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:10:57.481476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:10:57.482911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5dd1a7a651fa4d27a1b6488ca13effca"}]}] Jun 26 03:10:57.482911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:10:57.482911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 5dd1a7a651fa4d27a1b6488ca13effca Jun 26 03:10:57.482911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:10:57.482911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeShelveTestJSON-930384486-project Jun 26 03:10:57.482911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:10:57.482911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:10:57.482911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 430d2efc691e4aae9f96409b081c7e96 Jun 26 03:10:57.482911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeShelveTestJSON-930384486-project Jun 26 03:10:57.482911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:10:57.482911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:10:57.482911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '3b0d1d9b-d025-442c-a2f6-db22050d9059'} Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:10:57.483680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:10:57.484814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:10:57.485833 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9f359d26-d1f3-4f18-9f0d-14dc9381ab24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Returning 404 to user: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:10:57.485833 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9f359d26-d1f3-4f18-9f0d-14dc9381ab24 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 404 len: 111 microversion: 2.20 time: 0.030028 Jun 26 03:10:57.485833 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 356/719] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:10:57 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 26 03:10:57.493203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2f837b46-5d4a-49ad-8047-5a62268d28b3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '.version_select at 0x7f58276b8550>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:57.512545 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2f837b46-5d4a-49ad-8047-5a62268d28b3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-389962117" status: 204 len: 0 microversion: 2.20 time: 0.024184 Jun 26 03:10:57.513310 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 364/720] 10.222.0.13 () {60 vars in 1258 bytes} [Sun Jun 26 03:10:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-389962117 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 26 03:10:57.732810 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1cd0afd3-11cb-4f24-bb40-40ba1425df40 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:57.733428 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1cd0afd3-11cb-4f24-bb40-40ba1425df40 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:57.810992 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1cd0afd3-11cb-4f24-bb40-40ba1425df40 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:57.818487 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1cd0afd3-11cb-4f24-bb40-40ba1425df40 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1242 microversion: 2.1 time: 0.089643 Jun 26 03:10:57.819782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 357/721] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:57 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:58.212570 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-03e0df85-a99e-4ee1-afe9-a4ec82caf058 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Action: 'create', calling method: .version_select at 0x7f5827713160>, body: {"keypair": {"name": "tempest-keypair-1256657685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwVtYCoaqvxP01j/TuxtvaUpSwk1irBvSqdu5KRIZV3Zju7w7XsnRUoEgbzOqBQIoro/G3WDoRIg3HfiXm0ChF2whl0ooy+CApz5d8bjaA7+H24dH/AJcLVYS9E/d8ubA=="}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:58.227446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-03e0df85-a99e-4ee1-afe9-a4ec82caf058 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Getting quotas for project 5dd1a7a651fa4d27a1b6488ca13effca. Resources: {'key_pairs'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:10:58.231465 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-03e0df85-a99e-4ee1-afe9-a4ec82caf058 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Getting quotas for user 430d2efc691e4aae9f96409b081c7e96 and project 5dd1a7a651fa4d27a1b6488ca13effca. Resources: {'key_pairs'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:10:58.251938 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-03e0df85-a99e-4ee1-afe9-a4ec82caf058 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043965 Jun 26 03:10:58.252518 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 365/722] 10.222.0.13 () {62 vars in 1199 bytes} [Sun Jun 26 03:10:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 26 03:10:58.835581 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-38d9aa95-f0ff-4376-8caf-179b127e374c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:58.836828 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-38d9aa95-f0ff-4376-8caf-179b127e374c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:58.893396 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-38d9aa95-f0ff-4376-8caf-179b127e374c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:58.900126 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-38d9aa95-f0ff-4376-8caf-179b127e374c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1242 microversion: 2.1 time: 0.068359 Jun 26 03:10:58.900696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 358/723] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:58 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:10:59.481688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1221830398", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "151cdbb9-618f-46a1-a7b5-564e53db9cea"}], "security_groups": [{"name": "tempest-securitygroup--1751826760"}], "key_name": "tempest-keypair-1256657685", "user_data": "}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:10:59.579187 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] validate_networks() for [('151cdbb9-618f-46a1-a7b5-564e53db9cea', None, None, None, None, None)] {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:10:59.916785 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2a3cff5e-226c-4269-ae26-dcb799f58cc5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:10:59.917411 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2a3cff5e-226c-4269-ae26-dcb799f58cc5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:10:59.941728 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:10:59.942264 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:10:59.942825 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:10:59.943299 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:10:59.943812 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:10:59.953816 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:59.954298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:59.955092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:10:59.955529 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:10:59.970965 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2a3cff5e-226c-4269-ae26-dcb799f58cc5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:10:59.972360 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Getting quotas for project 5dd1a7a651fa4d27a1b6488ca13effca. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:10:59.976272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Getting quotas for user 430d2efc691e4aae9f96409b081c7e96 and project 5dd1a7a651fa4d27a1b6488ca13effca. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:10:59.977510 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2a3cff5e-226c-4269-ae26-dcb799f58cc5 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1242 microversion: 2.1 time: 0.064706 Jun 26 03:10:59.978291 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 359/724] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:10:59 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:10:59.987322 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:10:59.989697 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:11:00.035484 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a6f237b3-bff4-4f3d-9f76-7352c60bd705 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.559192 Jun 26 03:11:00.036122 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 366/725] 10.222.0.13 () {62 vars in 1187 bytes} [Sun Jun 26 03:10:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 26 03:11:00.046212 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c85a294f-29c0-4811-bec2-6fae409e9acc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:00.046907 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c85a294f-29c0-4811-bec2-6fae409e9acc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:00.104637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c85a294f-29c0-4811-bec2-6fae409e9acc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:00.119683 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c85a294f-29c0-4811-bec2-6fae409e9acc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:00.122630 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c85a294f-29c0-4811-bec2-6fae409e9acc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:00.123782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c85a294f-29c0-4811-bec2-6fae409e9acc tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1282 microversion: 2.20 time: 0.081689 Jun 26 03:11:00.124351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 360/726] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:00 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:11:00.994812 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-5a90c2f4-19b2-405f-93f8-436920b1d968 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:00.995422 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-5a90c2f4-19b2-405f-93f8-436920b1d968 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:01.001725 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5a90c2f4-19b2-405f-93f8-436920b1d968 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:01.002216 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5a90c2f4-19b2-405f-93f8-436920b1d968 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:01.002977 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5a90c2f4-19b2-405f-93f8-436920b1d968 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:01.003416 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5a90c2f4-19b2-405f-93f8-436920b1d968 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:01.062461 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-5a90c2f4-19b2-405f-93f8-436920b1d968 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:01.069534 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-5a90c2f4-19b2-405f-93f8-436920b1d968 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1246 microversion: 2.1 time: 0.079217 Jun 26 03:11:01.070106 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 367/727] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:00 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:01.142497 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-672a1962-c593-4c12-b364-2078c2824775 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:01.143104 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-672a1962-c593-4c12-b364-2078c2824775 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:01.150168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-672a1962-c593-4c12-b364-2078c2824775 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:01.150639 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-672a1962-c593-4c12-b364-2078c2824775 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:01.151374 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-672a1962-c593-4c12-b364-2078c2824775 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:01.151806 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-672a1962-c593-4c12-b364-2078c2824775 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:01.209469 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-672a1962-c593-4c12-b364-2078c2824775 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:01.211614 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:01.219483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-672a1962-c593-4c12-b364-2078c2824775 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:01.220970 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-672a1962-c593-4c12-b364-2078c2824775 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:01.222069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-672a1962-c593-4c12-b364-2078c2824775 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1286 microversion: 2.20 time: 0.083393 Jun 26 03:11:01.222626 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 361/728] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:01 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:11:02.086106 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2835d8cf-cad8-4bfc-a647-fb088c75aed2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:02.086668 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2835d8cf-cad8-4bfc-a647-fb088c75aed2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:02.093086 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2835d8cf-cad8-4bfc-a647-fb088c75aed2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:02.093515 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2835d8cf-cad8-4bfc-a647-fb088c75aed2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:02.094304 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2835d8cf-cad8-4bfc-a647-fb088c75aed2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:02.094744 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2835d8cf-cad8-4bfc-a647-fb088c75aed2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:02.157676 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-2835d8cf-cad8-4bfc-a647-fb088c75aed2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:02.165628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2835d8cf-cad8-4bfc-a647-fb088c75aed2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1300 microversion: 2.1 time: 0.082930 Jun 26 03:11:02.166220 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 368/729] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:02 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:02.239965 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b234eb3d-72fd-499b-8a18-ca902ff72fd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:02.240709 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b234eb3d-72fd-499b-8a18-ca902ff72fd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:02.248634 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b234eb3d-72fd-499b-8a18-ca902ff72fd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:02.249079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b234eb3d-72fd-499b-8a18-ca902ff72fd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:02.249834 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b234eb3d-72fd-499b-8a18-ca902ff72fd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:02.250313 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b234eb3d-72fd-499b-8a18-ca902ff72fd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:02.320451 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b234eb3d-72fd-499b-8a18-ca902ff72fd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:02.328439 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b234eb3d-72fd-499b-8a18-ca902ff72fd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:02.330021 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b234eb3d-72fd-499b-8a18-ca902ff72fd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:02.331273 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b234eb3d-72fd-499b-8a18-ca902ff72fd5 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1334 microversion: 2.20 time: 0.095104 Jun 26 03:11:02.331828 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 362/730] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:02 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:11:03.184010 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a6fde713-7806-4519-bbc4-824488caa59a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:03.184725 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a6fde713-7806-4519-bbc4-824488caa59a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:03.191062 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a6fde713-7806-4519-bbc4-824488caa59a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:03.191598 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a6fde713-7806-4519-bbc4-824488caa59a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:03.192478 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a6fde713-7806-4519-bbc4-824488caa59a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:03.193247 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a6fde713-7806-4519-bbc4-824488caa59a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:03.351478 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8e1c8812-798c-401e-8fdd-244f1c5d1f8e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:03.353458 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8e1c8812-798c-401e-8fdd-244f1c5d1f8e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:03.360751 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8e1c8812-798c-401e-8fdd-244f1c5d1f8e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:03.361399 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8e1c8812-798c-401e-8fdd-244f1c5d1f8e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:03.362600 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8e1c8812-798c-401e-8fdd-244f1c5d1f8e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:03.363208 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8e1c8812-798c-401e-8fdd-244f1c5d1f8e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:03.479866 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a6fde713-7806-4519-bbc4-824488caa59a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:03.489559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a6fde713-7806-4519-bbc4-824488caa59a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1368 microversion: 2.1 time: 0.309965 Jun 26 03:11:03.490962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 369/731] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:03 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:03.602969 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8e1c8812-798c-401e-8fdd-244f1c5d1f8e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:03.618025 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8e1c8812-798c-401e-8fdd-244f1c5d1f8e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:03.620044 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8e1c8812-798c-401e-8fdd-244f1c5d1f8e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:03.625798 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8e1c8812-798c-401e-8fdd-244f1c5d1f8e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1408 microversion: 2.20 time: 0.278498 Jun 26 03:11:03.626753 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 363/732] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:03 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:11:03.836010 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-485894c6-7d17-4ebf-aa85-e34b1f967cd5 req-468488e1-1166-4456-a301-4b7ce0a9760a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b07d92-79ab-4155-972b-7619661bd1d2", "tag": "fb7d2bf0-48c2-4a67-8477-72edf265c211"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:11:03.848270 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-485894c6-7d17-4ebf-aa85-e34b1f967cd5 req-468488e1-1166-4456-a301-4b7ce0a9760a service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:03.848760 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-485894c6-7d17-4ebf-aa85-e34b1f967cd5 req-468488e1-1166-4456-a301-4b7ce0a9760a service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:03.871421 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-485894c6-7d17-4ebf-aa85-e34b1f967cd5 req-468488e1-1166-4456-a301-4b7ce0a9760a service nova] Creating event network-changed:fb7d2bf0-48c2-4a67-8477-72edf265c211 for instance 16b07d92-79ab-4155-972b-7619661bd1d2 on hv-cinder-84684 Jun 26 03:11:03.882761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-485894c6-7d17-4ebf-aa85-e34b1f967cd5 req-468488e1-1166-4456-a301-4b7ce0a9760a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050155 Jun 26 03:11:03.887219 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 370/733] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:11:04.498690 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-cbfc8b5f-ceb8-48af-8de1-aea01693751c req-4a4b13ce-de09-4f8a-ba13-d4232a55e812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee71e3f2-a415-4000-97d4-290a4675ee4e", "tag": "7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:11:04.509640 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-7f0b2516-6c2e-4a41-ace2-8dea1582c1ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:04.510131 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-cbfc8b5f-ceb8-48af-8de1-aea01693751c req-4a4b13ce-de09-4f8a-ba13-d4232a55e812 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:04.511539 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-7f0b2516-6c2e-4a41-ace2-8dea1582c1ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:04.518315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7f0b2516-6c2e-4a41-ace2-8dea1582c1ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:04.519016 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7f0b2516-6c2e-4a41-ace2-8dea1582c1ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:04.519686 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-cbfc8b5f-ceb8-48af-8de1-aea01693751c req-4a4b13ce-de09-4f8a-ba13-d4232a55e812 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:04.520094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7f0b2516-6c2e-4a41-ace2-8dea1582c1ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:04.521073 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7f0b2516-6c2e-4a41-ace2-8dea1582c1ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:04.531811 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-cbfc8b5f-ceb8-48af-8de1-aea01693751c req-4a4b13ce-de09-4f8a-ba13-d4232a55e812 service nova] Creating event network-changed:7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6 for instance ee71e3f2-a415-4000-97d4-290a4675ee4e on hv-cinder-84684 Jun 26 03:11:04.536810 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-cbfc8b5f-ceb8-48af-8de1-aea01693751c req-4a4b13ce-de09-4f8a-ba13-d4232a55e812 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042300 Jun 26 03:11:04.537599 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 364/734] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:11:04.645850 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-48baadc3-e8ab-4a26-bdbc-4ce57fb38d46 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:04.646573 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-48baadc3-e8ab-4a26-bdbc-4ce57fb38d46 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:04.653461 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-48baadc3-e8ab-4a26-bdbc-4ce57fb38d46 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:04.653917 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-48baadc3-e8ab-4a26-bdbc-4ce57fb38d46 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:04.654730 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-48baadc3-e8ab-4a26-bdbc-4ce57fb38d46 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:04.655179 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-48baadc3-e8ab-4a26-bdbc-4ce57fb38d46 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:04.661851 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-7f0b2516-6c2e-4a41-ace2-8dea1582c1ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:04.669331 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-7f0b2516-6c2e-4a41-ace2-8dea1582c1ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1368 microversion: 2.1 time: 0.165728 Jun 26 03:11:04.669895 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 371/735] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:04 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:11:04.787275 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-48baadc3-e8ab-4a26-bdbc-4ce57fb38d46 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:04.795216 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-48baadc3-e8ab-4a26-bdbc-4ce57fb38d46 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:04.796727 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-48baadc3-e8ab-4a26-bdbc-4ce57fb38d46 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:04.797829 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-48baadc3-e8ab-4a26-bdbc-4ce57fb38d46 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1408 microversion: 2.20 time: 0.156851 Jun 26 03:11:04.798411 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 365/736] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:04 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:11:05.686248 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-17823a48-f309-42db-98ed-64ed67e3afb2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:05.686857 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-17823a48-f309-42db-98ed-64ed67e3afb2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:05.693769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17823a48-f309-42db-98ed-64ed67e3afb2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:05.694265 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17823a48-f309-42db-98ed-64ed67e3afb2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:05.695037 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17823a48-f309-42db-98ed-64ed67e3afb2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:05.695478 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17823a48-f309-42db-98ed-64ed67e3afb2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:05.816142 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-431d4881-7b8e-4da5-9fc5-85f602f0de30 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:05.816808 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-431d4881-7b8e-4da5-9fc5-85f602f0de30 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:05.823614 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-431d4881-7b8e-4da5-9fc5-85f602f0de30 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:05.824087 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-431d4881-7b8e-4da5-9fc5-85f602f0de30 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:05.824191 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-17823a48-f309-42db-98ed-64ed67e3afb2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:05.824850 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-431d4881-7b8e-4da5-9fc5-85f602f0de30 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:05.825288 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-431d4881-7b8e-4da5-9fc5-85f602f0de30 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:05.831849 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-17823a48-f309-42db-98ed-64ed67e3afb2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1368 microversion: 2.1 time: 0.149461 Jun 26 03:11:05.832415 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 372/737] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:05 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:05.953848 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-431d4881-7b8e-4da5-9fc5-85f602f0de30 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:05.961778 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-431d4881-7b8e-4da5-9fc5-85f602f0de30 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:05.963876 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-431d4881-7b8e-4da5-9fc5-85f602f0de30 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:05.964987 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-431d4881-7b8e-4da5-9fc5-85f602f0de30 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1408 microversion: 2.20 time: 0.152691 Jun 26 03:11:05.965553 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 366/738] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:05 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:11:06.858993 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0f53ffd6-9ff7-4598-a2ac-8424c3b4bafc tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:06.860645 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0f53ffd6-9ff7-4598-a2ac-8424c3b4bafc tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:06.867256 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0f53ffd6-9ff7-4598-a2ac-8424c3b4bafc tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:06.867707 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0f53ffd6-9ff7-4598-a2ac-8424c3b4bafc tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:06.868540 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0f53ffd6-9ff7-4598-a2ac-8424c3b4bafc tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:06.868978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0f53ffd6-9ff7-4598-a2ac-8424c3b4bafc tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:06.983738 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1f09ce88-831e-4a28-9744-82e46ba2b171 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:06.984608 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1f09ce88-831e-4a28-9744-82e46ba2b171 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:06.996841 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1f09ce88-831e-4a28-9744-82e46ba2b171 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:06.997423 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1f09ce88-831e-4a28-9744-82e46ba2b171 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:06.998337 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1f09ce88-831e-4a28-9744-82e46ba2b171 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:06.999050 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1f09ce88-831e-4a28-9744-82e46ba2b171 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:07.121089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0f53ffd6-9ff7-4598-a2ac-8424c3b4bafc tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:07.129348 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0f53ffd6-9ff7-4598-a2ac-8424c3b4bafc tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1368 microversion: 2.1 time: 0.280028 Jun 26 03:11:07.130222 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 373/739] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:06 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1368 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:07.249329 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1f09ce88-831e-4a28-9744-82e46ba2b171 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:07.259402 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1f09ce88-831e-4a28-9744-82e46ba2b171 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:07.260915 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1f09ce88-831e-4a28-9744-82e46ba2b171 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:07.262024 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1f09ce88-831e-4a28-9744-82e46ba2b171 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1408 microversion: 2.20 time: 0.282214 Jun 26 03:11:07.262607 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 367/740] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:06 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1408 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:11:08.148041 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-da9be8f0-7077-4516-a2a3-f2652b09d07e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:08.148648 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-da9be8f0-7077-4516-a2a3-f2652b09d07e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:08.155023 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-da9be8f0-7077-4516-a2a3-f2652b09d07e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:08.155471 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-da9be8f0-7077-4516-a2a3-f2652b09d07e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:08.156224 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-da9be8f0-7077-4516-a2a3-f2652b09d07e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:08.156658 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-da9be8f0-7077-4516-a2a3-f2652b09d07e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:08.279964 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2c882f98-1c16-4328-90cc-65a119471c52 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:08.280568 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2c882f98-1c16-4328-90cc-65a119471c52 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:08.287014 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2c882f98-1c16-4328-90cc-65a119471c52 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:08.287463 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2c882f98-1c16-4328-90cc-65a119471c52 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:08.287884 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-da9be8f0-7077-4516-a2a3-f2652b09d07e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:08.288230 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2c882f98-1c16-4328-90cc-65a119471c52 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:08.288667 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2c882f98-1c16-4328-90cc-65a119471c52 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:08.296051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-da9be8f0-7077-4516-a2a3-f2652b09d07e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1368 microversion: 2.1 time: 0.151693 Jun 26 03:11:08.296661 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 374/741] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:08 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:08.418189 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2c882f98-1c16-4328-90cc-65a119471c52 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:08.427350 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2c882f98-1c16-4328-90cc-65a119471c52 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:08.428400 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2c882f98-1c16-4328-90cc-65a119471c52 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:08.429506 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2c882f98-1c16-4328-90cc-65a119471c52 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1408 microversion: 2.20 time: 0.153597 Jun 26 03:11:08.430092 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 368/742] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:08 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:11:09.313295 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-93c518f5-0b53-4854-9f2a-4b44e761724b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:09.313900 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-93c518f5-0b53-4854-9f2a-4b44e761724b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:09.320255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-93c518f5-0b53-4854-9f2a-4b44e761724b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:09.320709 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-93c518f5-0b53-4854-9f2a-4b44e761724b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:09.322068 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-93c518f5-0b53-4854-9f2a-4b44e761724b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:09.322516 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-93c518f5-0b53-4854-9f2a-4b44e761724b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:09.447307 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9aa7543a-3581-47fb-8e1c-eabff1dce11a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:09.447918 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9aa7543a-3581-47fb-8e1c-eabff1dce11a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:09.448032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-93c518f5-0b53-4854-9f2a-4b44e761724b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:09.454727 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9aa7543a-3581-47fb-8e1c-eabff1dce11a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:09.455113 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9aa7543a-3581-47fb-8e1c-eabff1dce11a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:09.455341 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-93c518f5-0b53-4854-9f2a-4b44e761724b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1368 microversion: 2.1 time: 0.145871 Jun 26 03:11:09.455865 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9aa7543a-3581-47fb-8e1c-eabff1dce11a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:09.455962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 375/743] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:09 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:09.456362 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9aa7543a-3581-47fb-8e1c-eabff1dce11a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:09.584139 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9aa7543a-3581-47fb-8e1c-eabff1dce11a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:09.592073 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9aa7543a-3581-47fb-8e1c-eabff1dce11a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:09.593565 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9aa7543a-3581-47fb-8e1c-eabff1dce11a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:09.594702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9aa7543a-3581-47fb-8e1c-eabff1dce11a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1408 microversion: 2.20 time: 0.151282 Jun 26 03:11:09.595270 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 369/744] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:09 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:11:10.472056 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-47cf4d11-dc9e-4e93-a018-005fca7fb991 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:10.472694 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-47cf4d11-dc9e-4e93-a018-005fca7fb991 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:10.475667 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=4 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:10.476461 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=20 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:10.481301 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47cf4d11-dc9e-4e93-a018-005fca7fb991 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:10.481754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47cf4d11-dc9e-4e93-a018-005fca7fb991 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:10.482664 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47cf4d11-dc9e-4e93-a018-005fca7fb991 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:10.483016 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47cf4d11-dc9e-4e93-a018-005fca7fb991 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:10.612858 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-47cf4d11-dc9e-4e93-a018-005fca7fb991 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:10.613044 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8d716475-ac72-44bd-a98a-54510702a85d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:10.613544 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8d716475-ac72-44bd-a98a-54510702a85d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:10.620105 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=10 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:10.620748 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-47cf4d11-dc9e-4e93-a018-005fca7fb991 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1368 microversion: 2.1 time: 0.152475 Jun 26 03:11:10.621708 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 376/745] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:10 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:10.622865 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8d716475-ac72-44bd-a98a-54510702a85d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:10.623455 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8d716475-ac72-44bd-a98a-54510702a85d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:10.624350 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8d716475-ac72-44bd-a98a-54510702a85d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:10.624850 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8d716475-ac72-44bd-a98a-54510702a85d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:10.757499 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8d716475-ac72-44bd-a98a-54510702a85d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:10.769983 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8d716475-ac72-44bd-a98a-54510702a85d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:10.771192 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8d716475-ac72-44bd-a98a-54510702a85d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:10.772577 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8d716475-ac72-44bd-a98a-54510702a85d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1408 microversion: 2.20 time: 0.163692 Jun 26 03:11:10.773136 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 370/746] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:10 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:11:10.824179 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-de20593a-7d28-4f16-96be-c8211b984091 req-e25ea17f-00b2-4a28-a5f0-02089326e3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b07d92-79ab-4155-972b-7619661bd1d2", "name": "network-vif-plugged", "status": "completed", "tag": "fb7d2bf0-48c2-4a67-8477-72edf265c211"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:11:10.832337 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-de20593a-7d28-4f16-96be-c8211b984091 req-e25ea17f-00b2-4a28-a5f0-02089326e3ea service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:10.832984 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-de20593a-7d28-4f16-96be-c8211b984091 req-e25ea17f-00b2-4a28-a5f0-02089326e3ea service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:10.843625 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-de20593a-7d28-4f16-96be-c8211b984091 req-e25ea17f-00b2-4a28-a5f0-02089326e3ea service nova] Creating event network-vif-plugged:fb7d2bf0-48c2-4a67-8477-72edf265c211 for instance 16b07d92-79ab-4155-972b-7619661bd1d2 on hv-cinder-84684 Jun 26 03:11:10.848874 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-de20593a-7d28-4f16-96be-c8211b984091 req-e25ea17f-00b2-4a28-a5f0-02089326e3ea service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093232 Jun 26 03:11:10.849974 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 377/747] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:11:11.638379 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6efa479d-2059-46ee-8b2d-8c150fda868b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:11.638988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-6efa479d-2059-46ee-8b2d-8c150fda868b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:11.645450 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6efa479d-2059-46ee-8b2d-8c150fda868b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:11.645849 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6efa479d-2059-46ee-8b2d-8c150fda868b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:11.646644 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6efa479d-2059-46ee-8b2d-8c150fda868b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:11.647083 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6efa479d-2059-46ee-8b2d-8c150fda868b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:11.781460 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-6efa479d-2059-46ee-8b2d-8c150fda868b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:11.789022 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6efa479d-2059-46ee-8b2d-8c150fda868b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1368 microversion: 2.1 time: 0.154415 Jun 26 03:11:11.789590 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 371/748] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:11 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:11.790904 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-04d4c55b-b8f9-4ac1-8166-69adf0148bc0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:11.791599 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-04d4c55b-b8f9-4ac1-8166-69adf0148bc0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:11.798280 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-04d4c55b-b8f9-4ac1-8166-69adf0148bc0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:11.798747 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-04d4c55b-b8f9-4ac1-8166-69adf0148bc0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:11.799517 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-04d4c55b-b8f9-4ac1-8166-69adf0148bc0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:11.799960 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-04d4c55b-b8f9-4ac1-8166-69adf0148bc0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:11.925655 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-04d4c55b-b8f9-4ac1-8166-69adf0148bc0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:11.933643 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-04d4c55b-b8f9-4ac1-8166-69adf0148bc0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:11.935204 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-04d4c55b-b8f9-4ac1-8166-69adf0148bc0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:11.936297 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-04d4c55b-b8f9-4ac1-8166-69adf0148bc0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1408 microversion: 2.20 time: 0.149560 Jun 26 03:11:11.936878 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 378/749] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:11 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:11:12.805485 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-015ab3d4-282f-4425-b116-8e2ee5e1821b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:12.806821 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-015ab3d4-282f-4425-b116-8e2ee5e1821b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:12.813502 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-015ab3d4-282f-4425-b116-8e2ee5e1821b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:12.813956 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-015ab3d4-282f-4425-b116-8e2ee5e1821b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:12.814745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-015ab3d4-282f-4425-b116-8e2ee5e1821b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:12.815211 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-015ab3d4-282f-4425-b116-8e2ee5e1821b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:12.863008 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-aabb9cd0-7187-40bd-b496-1a6d26d5a01c req-0bf8200a-9f65-47d4-9e2f-a922dd65c77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee71e3f2-a415-4000-97d4-290a4675ee4e", "name": "network-vif-plugged", "status": "completed", "tag": "7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:11:12.871682 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-aabb9cd0-7187-40bd-b496-1a6d26d5a01c req-0bf8200a-9f65-47d4-9e2f-a922dd65c77a service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:12.872121 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-aabb9cd0-7187-40bd-b496-1a6d26d5a01c req-0bf8200a-9f65-47d4-9e2f-a922dd65c77a service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:12.883533 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-aabb9cd0-7187-40bd-b496-1a6d26d5a01c req-0bf8200a-9f65-47d4-9e2f-a922dd65c77a service nova] Creating event network-vif-plugged:7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6 for instance ee71e3f2-a415-4000-97d4-290a4675ee4e on hv-cinder-84684 Jun 26 03:11:12.888994 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-aabb9cd0-7187-40bd-b496-1a6d26d5a01c req-0bf8200a-9f65-47d4-9e2f-a922dd65c77a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029372 Jun 26 03:11:12.889588 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 379/750] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:11:12.945175 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-015ab3d4-282f-4425-b116-8e2ee5e1821b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:12.952549 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-015ab3d4-282f-4425-b116-8e2ee5e1821b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1368 microversion: 2.1 time: 0.151032 Jun 26 03:11:12.953107 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 372/751] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:12 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:12.955198 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e0b69136-208e-465e-baf6-1e7ae6a9be04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:12.955887 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e0b69136-208e-465e-baf6-1e7ae6a9be04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:12.962530 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e0b69136-208e-465e-baf6-1e7ae6a9be04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:12.962976 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e0b69136-208e-465e-baf6-1e7ae6a9be04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:12.963730 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e0b69136-208e-465e-baf6-1e7ae6a9be04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:12.964166 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e0b69136-208e-465e-baf6-1e7ae6a9be04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:13.093296 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e0b69136-208e-465e-baf6-1e7ae6a9be04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:13.101078 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e0b69136-208e-465e-baf6-1e7ae6a9be04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:13.103246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e0b69136-208e-465e-baf6-1e7ae6a9be04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:13.104338 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e0b69136-208e-465e-baf6-1e7ae6a9be04 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1408 microversion: 2.20 time: 0.153290 Jun 26 03:11:13.104896 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 380/752] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:12 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:11:13.968697 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2f99cfd7-3d52-46fd-843b-e97f8544c2b4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:13.969312 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2f99cfd7-3d52-46fd-843b-e97f8544c2b4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:13.975744 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2f99cfd7-3d52-46fd-843b-e97f8544c2b4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:13.976200 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2f99cfd7-3d52-46fd-843b-e97f8544c2b4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:13.976966 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2f99cfd7-3d52-46fd-843b-e97f8544c2b4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:13.977899 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2f99cfd7-3d52-46fd-843b-e97f8544c2b4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:14.109863 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2f99cfd7-3d52-46fd-843b-e97f8544c2b4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:14.118635 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2f99cfd7-3d52-46fd-843b-e97f8544c2b4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1558 microversion: 2.1 time: 0.153237 Jun 26 03:11:14.119209 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 373/753] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:13 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:14.122904 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0c1ca760-0015-4d03-8a8c-d660556b3e7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:14.123515 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0c1ca760-0015-4d03-8a8c-d660556b3e7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:14.130434 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0c1ca760-0015-4d03-8a8c-d660556b3e7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:14.130777 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0c1ca760-0015-4d03-8a8c-d660556b3e7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:14.131551 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0c1ca760-0015-4d03-8a8c-d660556b3e7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:14.131992 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0c1ca760-0015-4d03-8a8c-d660556b3e7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:14.134450 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c1171827-aa76-46b0-8ead-e2e1e6847f38 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:14.134953 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c1171827-aa76-46b0-8ead-e2e1e6847f38 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:14.140757 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c1171827-aa76-46b0-8ead-e2e1e6847f38 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:14.141213 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c1171827-aa76-46b0-8ead-e2e1e6847f38 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:14.141976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c1171827-aa76-46b0-8ead-e2e1e6847f38 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:14.142442 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c1171827-aa76-46b0-8ead-e2e1e6847f38 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:14.245994 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c1171827-aa76-46b0-8ead-e2e1e6847f38 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115129 Jun 26 03:11:14.246656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 374/754] 10.222.0.13 () {58 vars in 1274 bytes} [Sun Jun 26 03:11:14 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:11:14.288770 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0c1ca760-0015-4d03-8a8c-d660556b3e7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:14.297444 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0c1ca760-0015-4d03-8a8c-d660556b3e7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:14.298983 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0c1ca760-0015-4d03-8a8c-d660556b3e7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:14.300096 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0c1ca760-0015-4d03-8a8c-d660556b3e7d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1408 microversion: 2.20 time: 0.181213 Jun 26 03:11:14.300650 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 381/755] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:14 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:11:15.148418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-83094027-8977-421b-bd6e-310643822b9d req-0a0cc1f0-1460-48bf-83b5-c23ee9ca13c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b07d92-79ab-4155-972b-7619661bd1d2", "tag": "fb7d2bf0-48c2-4a67-8477-72edf265c211"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:11:15.156488 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-83094027-8977-421b-bd6e-310643822b9d req-0a0cc1f0-1460-48bf-83b5-c23ee9ca13c2 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:15.156938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-83094027-8977-421b-bd6e-310643822b9d req-0a0cc1f0-1460-48bf-83b5-c23ee9ca13c2 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:15.167871 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-83094027-8977-421b-bd6e-310643822b9d req-0a0cc1f0-1460-48bf-83b5-c23ee9ca13c2 service nova] Creating event network-changed:fb7d2bf0-48c2-4a67-8477-72edf265c211 for instance 16b07d92-79ab-4155-972b-7619661bd1d2 on hv-cinder-84684 Jun 26 03:11:15.173220 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-83094027-8977-421b-bd6e-310643822b9d req-0a0cc1f0-1460-48bf-83b5-c23ee9ca13c2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028831 Jun 26 03:11:15.174155 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 375/756] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:11:15.318594 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a2472ca7-d71a-4ba1-86e6-3df039d3e43c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:15.319216 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a2472ca7-d71a-4ba1-86e6-3df039d3e43c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:15.326467 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a2472ca7-d71a-4ba1-86e6-3df039d3e43c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:15.327402 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a2472ca7-d71a-4ba1-86e6-3df039d3e43c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:15.327734 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a2472ca7-d71a-4ba1-86e6-3df039d3e43c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:15.328165 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a2472ca7-d71a-4ba1-86e6-3df039d3e43c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:15.459430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a2472ca7-d71a-4ba1-86e6-3df039d3e43c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:15.467463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a2472ca7-d71a-4ba1-86e6-3df039d3e43c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:15.468987 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a2472ca7-d71a-4ba1-86e6-3df039d3e43c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:15.470177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a2472ca7-d71a-4ba1-86e6-3df039d3e43c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1600 microversion: 2.20 time: 0.155832 Jun 26 03:11:15.470749 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 382/757] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:11:15 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:11:15.488866 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2b974925-f349-49a1-bd0a-2214578c16ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:15.489451 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2b974925-f349-49a1-bd0a-2214578c16ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:15.496231 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2b974925-f349-49a1-bd0a-2214578c16ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:15.496686 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2b974925-f349-49a1-bd0a-2214578c16ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:15.497455 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2b974925-f349-49a1-bd0a-2214578c16ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:15.497898 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2b974925-f349-49a1-bd0a-2214578c16ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:15.574821 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2b974925-f349-49a1-bd0a-2214578c16ad tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090124 Jun 26 03:11:15.575507 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 376/758] 10.222.0.13 () {60 vars in 1315 bytes} [Sun Jun 26 03:11:15 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 03:11:17.188426 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-e606bd16-4491-4928-b5e6-a3286dc5c08c req-d8888565-5de2-4797-af56-19b1edd2ab94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee71e3f2-a415-4000-97d4-290a4675ee4e", "tag": "7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:11:17.197346 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-e606bd16-4491-4928-b5e6-a3286dc5c08c req-d8888565-5de2-4797-af56-19b1edd2ab94 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:17.197791 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-e606bd16-4491-4928-b5e6-a3286dc5c08c req-d8888565-5de2-4797-af56-19b1edd2ab94 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:17.209074 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-e606bd16-4491-4928-b5e6-a3286dc5c08c req-d8888565-5de2-4797-af56-19b1edd2ab94 service nova] Creating event network-changed:7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6 for instance ee71e3f2-a415-4000-97d4-290a4675ee4e on hv-cinder-84684 Jun 26 03:11:17.214419 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-e606bd16-4491-4928-b5e6-a3286dc5c08c req-d8888565-5de2-4797-af56-19b1edd2ab94 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029589 Jun 26 03:11:17.214991 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 383/759] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:11:33.400592 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:11:33.401178 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Sun Jun 26 03:11:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:11:36.343082 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:36.343901 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=79 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:36.348204 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-56c706d5-1d3c-4236-9e6f-e44725642a74 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:36.349151 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-56c706d5-1d3c-4236-9e6f-e44725642a74 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:36.356928 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-56c706d5-1d3c-4236-9e6f-e44725642a74 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:36.357374 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-56c706d5-1d3c-4236-9e6f-e44725642a74 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:36.358164 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-56c706d5-1d3c-4236-9e6f-e44725642a74 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:36.358604 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-56c706d5-1d3c-4236-9e6f-e44725642a74 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:36.387148 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-56c706d5-1d3c-4236-9e6f-e44725642a74 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045539 Jun 26 03:11:36.387691 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 377/760] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:11:36 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 26 03:11:36.440854 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:36.441586 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=94 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:36.445547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3c676e98-68b8-4ef3-8007-f6cf30fc6027 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:36.446668 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3c676e98-68b8-4ef3-8007-f6cf30fc6027 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:36.453720 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c676e98-68b8-4ef3-8007-f6cf30fc6027 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:36.454226 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c676e98-68b8-4ef3-8007-f6cf30fc6027 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:36.454983 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c676e98-68b8-4ef3-8007-f6cf30fc6027 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:36.455423 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3c676e98-68b8-4ef3-8007-f6cf30fc6027 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:36.480133 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3c676e98-68b8-4ef3-8007-f6cf30fc6027 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:11:36.551683 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3c676e98-68b8-4ef3-8007-f6cf30fc6027 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 204 len: 0 microversion: 2.1 time: 0.112123 Jun 26 03:11:36.552340 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 384/761] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:11:36 2022] DELETE /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:11:36.562439 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-95da6aaf-b1d5-45f1-87bb-a7b9ec040cbd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:36.563067 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-95da6aaf-b1d5-45f1-87bb-a7b9ec040cbd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:36.569401 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-95da6aaf-b1d5-45f1-87bb-a7b9ec040cbd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:36.569855 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-95da6aaf-b1d5-45f1-87bb-a7b9ec040cbd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:36.570888 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-95da6aaf-b1d5-45f1-87bb-a7b9ec040cbd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:36.571843 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-95da6aaf-b1d5-45f1-87bb-a7b9ec040cbd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:36.699206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-95da6aaf-b1d5-45f1-87bb-a7b9ec040cbd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:36.706662 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-95da6aaf-b1d5-45f1-87bb-a7b9ec040cbd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1674 microversion: 2.1 time: 0.149823 Jun 26 03:11:36.707228 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 378/762] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:36 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:37.724764 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2a4ca955-4b5e-419c-ac1b-e8bac06c7e6a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:37.725459 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2a4ca955-4b5e-419c-ac1b-e8bac06c7e6a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:37.732879 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a4ca955-4b5e-419c-ac1b-e8bac06c7e6a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:37.733352 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a4ca955-4b5e-419c-ac1b-e8bac06c7e6a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:37.734143 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a4ca955-4b5e-419c-ac1b-e8bac06c7e6a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:37.734584 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a4ca955-4b5e-419c-ac1b-e8bac06c7e6a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:37.869181 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-2a4ca955-4b5e-419c-ac1b-e8bac06c7e6a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:37.876789 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2a4ca955-4b5e-419c-ac1b-e8bac06c7e6a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1674 microversion: 2.1 time: 0.156374 Jun 26 03:11:37.877350 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 385/763] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:37 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:38.895964 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b286dc59-5991-4d49-af7a-19d8193834d0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:38.898542 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b286dc59-5991-4d49-af7a-19d8193834d0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:38.906337 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-f3d03222-eb29-47a3-8214-4f856f8276af req-31fa6712-2367-4855-9fe7-5c68cfbf241c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c55ca6d-bad0-4964-83fe-4352b7fb1b1d", "name": "network-vif-deleted", "tag": "2d68efe6-d264-4cfb-8cd4-414d529eb007"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:11:38.918376 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b286dc59-5991-4d49-af7a-19d8193834d0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:38.918932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b286dc59-5991-4d49-af7a-19d8193834d0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:38.920674 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b286dc59-5991-4d49-af7a-19d8193834d0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:38.921369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b286dc59-5991-4d49-af7a-19d8193834d0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:38.926550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-f3d03222-eb29-47a3-8214-4f856f8276af req-31fa6712-2367-4855-9fe7-5c68cfbf241c service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:38.927249 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-f3d03222-eb29-47a3-8214-4f856f8276af req-31fa6712-2367-4855-9fe7-5c68cfbf241c service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:38.947331 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-f3d03222-eb29-47a3-8214-4f856f8276af req-31fa6712-2367-4855-9fe7-5c68cfbf241c service nova] Creating event network-vif-deleted:2d68efe6-d264-4cfb-8cd4-414d529eb007 for instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d on hv-cinder-84684 Jun 26 03:11:38.952470 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-f3d03222-eb29-47a3-8214-4f856f8276af req-31fa6712-2367-4855-9fe7-5c68cfbf241c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049763 Jun 26 03:11:38.953291 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 386/764] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:11:39.031884 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b286dc59-5991-4d49-af7a-19d8193834d0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:39.043716 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b286dc59-5991-4d49-af7a-19d8193834d0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 200 len: 1607 microversion: 2.1 time: 0.152864 Jun 26 03:11:39.062677 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 379/765] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:38 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 1607 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:40.071774 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3bb31791-d846-4c3f-8ed6-6c08ebeb987b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:40.072492 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3bb31791-d846-4c3f-8ed6-6c08ebeb987b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:40.079243 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3bb31791-d846-4c3f-8ed6-6c08ebeb987b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:40.079688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3bb31791-d846-4c3f-8ed6-6c08ebeb987b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:40.080446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3bb31791-d846-4c3f-8ed6-6c08ebeb987b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:40.080885 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3bb31791-d846-4c3f-8ed6-6c08ebeb987b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:40.093680 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-3bb31791-d846-4c3f-8ed6-6c08ebeb987b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] HTTP exception thrown: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3bb31791-d846-4c3f-8ed6-6c08ebeb987b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Request method failure captured: Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d HTTP/1.1 Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zOFbTovpqGhW0szkPta9b7uIMmMog_KiOJEvaQFjSoDidiLUL0aQ6VkpUL7F_BJNMiTm4CoTWRso7rpu262e18AfKVcnmu1MYHMNKU5rgQ2DPXJ1yMUjaCvmjrfPf-CDZ3vpadspHUHH9rssEdURNKRCveNXKcolRqPs0z4_JxeGo Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: ea86edd65ecb4972ba8bb33b34387432 Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:11:40.095285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:11:40.096892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea86edd65ecb4972ba8bb33b34387432"}]}] Jun 26 03:11:40.096892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:11:40.096892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: ea86edd65ecb4972ba8bb33b34387432 Jun 26 03:11:40.096892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:11:40.096892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-AttachVolumeTestJSON-26732284-project Jun 26 03:11:40.096892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:11:40.096892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:11:40.096892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 95793ccb15844069890363d983f1680d Jun 26 03:11:40.096892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-AttachVolumeTestJSON-26732284-project Jun 26 03:11:40.096892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:11:40.096892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:11:40.096892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '1c55ca6d-bad0-4964-83fe-4352b7fb1b1d'} Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:11:40.097797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:11:40.099031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:11:40.100120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3bb31791-d846-4c3f-8ed6-6c08ebeb987b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Returning 404 to user: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:11:40.100120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3bb31791-d846-4c3f-8ed6-6c08ebeb987b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 404 len: 111 microversion: 2.1 time: 0.030144 Jun 26 03:11:40.100120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 387/766] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:40 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:11:40.105756 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-60b5ca22-0b29-4cc6-8652-9ae8d52dcc9a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '.version_select at 0x7f58276109d0>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:40.123717 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-60b5ca22-0b29-4cc6-8652-9ae8d52dcc9a tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875808098" status: 202 len: 0 microversion: 2.1 time: 0.022078 Jun 26 03:11:40.124258 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 380/767] 10.222.0.13 () {58 vars in 1220 bytes} [Sun Jun 26 03:11:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875808098 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:11:40.953063 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6a265cab-fcfd-4b97-acbe-f6c8f8617a8c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Action: 'create', calling method: .version_select at 0x7f5827636b80>, body: {"keypair": {"name": "tempest-keypair-1947287630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9RFS6WcUIqzcC/SkvUf+jhngdgp+2LFUSFlIycosmMn3yFB/KXPPY2x0+r1lLF7WJeg/HGFqjYroimiZoDjkYXBIA4ld81bxGbH/C0AWl8WDOVbi0fcYYkGuNjYH76Ow=="}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:11:40.967296 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-6a265cab-fcfd-4b97-acbe-f6c8f8617a8c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Getting quotas for project ea86edd65ecb4972ba8bb33b34387432. Resources: {'key_pairs'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:11:40.970959 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-6a265cab-fcfd-4b97-acbe-f6c8f8617a8c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Getting quotas for user 95793ccb15844069890363d983f1680d and project ea86edd65ecb4972ba8bb33b34387432. Resources: {'key_pairs'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:11:40.991603 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6a265cab-fcfd-4b97-acbe-f6c8f8617a8c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.042450 Jun 26 03:11:40.992176 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 388/768] 10.222.0.13 () {60 vars in 1158 bytes} [Sun Jun 26 03:11:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:11:42.463522 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1750898665", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "74573779-88f3-4aaa-82c6-e30fd16eafe2"}], "security_groups": [{"name": "tempest-securitygroup--1916240775"}], "key_name": "tempest-keypair-1947287630", "user_data": "}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:11:42.561331 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.network.neutron [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] validate_networks() for [('74573779-88f3-4aaa-82c6-e30fd16eafe2', None, None, None, None, None)] {{(pid=117782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:11:42.965561 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Flavor limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:11:42.965996 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Image limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:11:42.966505 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Flavor pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:11:42.966916 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Image pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:11:42.967328 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:11:42.975939 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:42.976394 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:42.977810 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:42.978298 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:42.994545 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Getting quotas for project ea86edd65ecb4972ba8bb33b34387432. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:11:42.998437 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Getting quotas for user 95793ccb15844069890363d983f1680d and project ea86edd65ecb4972ba8bb33b34387432. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:11:43.009342 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Going to run 1 instances... {{(pid=117782) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:11:43.011581 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:11:43.058137 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2f4d9993-d123-4455-bcfa-1b0409285aac tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.599270 Jun 26 03:11:43.058783 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 381/769] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:11:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:11:43.069215 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1bcbd716-6123-4658-81f6-8f50c7b5e064 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:43.069881 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1bcbd716-6123-4658-81f6-8f50c7b5e064 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:43.128482 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1bcbd716-6123-4658-81f6-8f50c7b5e064 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:43.136571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1bcbd716-6123-4658-81f6-8f50c7b5e064 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1238 microversion: 2.1 time: 0.071605 Jun 26 03:11:43.137210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 389/770] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:43 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:11:44.154014 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-dd60a799-faeb-418c-a629-179005ca4a1d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:44.155491 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-dd60a799-faeb-418c-a629-179005ca4a1d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:44.162668 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd60a799-faeb-418c-a629-179005ca4a1d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:44.163458 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd60a799-faeb-418c-a629-179005ca4a1d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:44.164356 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd60a799-faeb-418c-a629-179005ca4a1d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:44.164834 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd60a799-faeb-418c-a629-179005ca4a1d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:44.229157 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-dd60a799-faeb-418c-a629-179005ca4a1d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:44.237238 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-dd60a799-faeb-418c-a629-179005ca4a1d tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1296 microversion: 2.1 time: 0.088415 Jun 26 03:11:44.237799 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 382/771] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:44 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:45.255592 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-67b218f2-6635-413c-b458-139e7762fda3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:45.256238 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-67b218f2-6635-413c-b458-139e7762fda3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:45.263352 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-67b218f2-6635-413c-b458-139e7762fda3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:45.263807 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-67b218f2-6635-413c-b458-139e7762fda3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:45.264579 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-67b218f2-6635-413c-b458-139e7762fda3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:45.265024 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-67b218f2-6635-413c-b458-139e7762fda3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:45.399744 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-67b218f2-6635-413c-b458-139e7762fda3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:45.407689 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-67b218f2-6635-413c-b458-139e7762fda3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1364 microversion: 2.1 time: 0.156704 Jun 26 03:11:45.408511 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 390/772] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:45 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:45.562016 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-2fa1f1d2-3418-4d90-ac94-60540577e28c req-bfd925a6-033f-4a48-be8f-7fd0f8a8417b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a783f9a-6fb1-478a-8b64-b4ed9830b33f", "tag": "98cb08d8-ef21-4ac4-a52f-3d665ef4ed53"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:11:45.570410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-2fa1f1d2-3418-4d90-ac94-60540577e28c req-bfd925a6-033f-4a48-be8f-7fd0f8a8417b service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:45.570904 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-2fa1f1d2-3418-4d90-ac94-60540577e28c req-bfd925a6-033f-4a48-be8f-7fd0f8a8417b service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:45.583167 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-2fa1f1d2-3418-4d90-ac94-60540577e28c req-bfd925a6-033f-4a48-be8f-7fd0f8a8417b service nova] Creating event network-changed:98cb08d8-ef21-4ac4-a52f-3d665ef4ed53 for instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f on hv-cinder-84684 Jun 26 03:11:45.588323 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-2fa1f1d2-3418-4d90-ac94-60540577e28c req-bfd925a6-033f-4a48-be8f-7fd0f8a8417b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029842 Jun 26 03:11:45.588874 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 383/773] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:11:46.424690 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-70af898f-ca40-4825-ac0c-257313a77645 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:46.425540 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-70af898f-ca40-4825-ac0c-257313a77645 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:46.432154 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-70af898f-ca40-4825-ac0c-257313a77645 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:46.432605 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-70af898f-ca40-4825-ac0c-257313a77645 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:46.433364 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-70af898f-ca40-4825-ac0c-257313a77645 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:46.433800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-70af898f-ca40-4825-ac0c-257313a77645 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:46.572729 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-70af898f-ca40-4825-ac0c-257313a77645 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:46.580182 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-70af898f-ca40-4825-ac0c-257313a77645 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1364 microversion: 2.1 time: 0.159466 Jun 26 03:11:46.580744 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 391/774] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:46 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:47.597812 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-70d86510-1a47-47e4-ba6e-3375d24ebdaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:47.598552 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-70d86510-1a47-47e4-ba6e-3375d24ebdaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:47.605374 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70d86510-1a47-47e4-ba6e-3375d24ebdaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:47.605827 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70d86510-1a47-47e4-ba6e-3375d24ebdaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:47.606622 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70d86510-1a47-47e4-ba6e-3375d24ebdaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:47.607071 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70d86510-1a47-47e4-ba6e-3375d24ebdaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:47.733770 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-70d86510-1a47-47e4-ba6e-3375d24ebdaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:47.741692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-70d86510-1a47-47e4-ba6e-3375d24ebdaa tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1364 microversion: 2.1 time: 0.148633 Jun 26 03:11:47.742301 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 384/775] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:47 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:48.759922 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-196806d9-2a81-4c70-9401-c1602e918d94 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:48.760520 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-196806d9-2a81-4c70-9401-c1602e918d94 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:48.767030 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-196806d9-2a81-4c70-9401-c1602e918d94 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:48.767479 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-196806d9-2a81-4c70-9401-c1602e918d94 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:48.768230 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-196806d9-2a81-4c70-9401-c1602e918d94 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:48.768664 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-196806d9-2a81-4c70-9401-c1602e918d94 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:48.896690 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-196806d9-2a81-4c70-9401-c1602e918d94 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:48.904102 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-196806d9-2a81-4c70-9401-c1602e918d94 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1364 microversion: 2.1 time: 0.148611 Jun 26 03:11:48.906369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 392/776] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:48 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:49.920660 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a19bf284-b2fb-4d34-9926-87b25bd25b58 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:49.921201 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a19bf284-b2fb-4d34-9926-87b25bd25b58 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:49.927616 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a19bf284-b2fb-4d34-9926-87b25bd25b58 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:49.928063 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a19bf284-b2fb-4d34-9926-87b25bd25b58 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:49.928814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a19bf284-b2fb-4d34-9926-87b25bd25b58 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:49.929251 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a19bf284-b2fb-4d34-9926-87b25bd25b58 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:50.056589 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a19bf284-b2fb-4d34-9926-87b25bd25b58 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:50.063806 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a19bf284-b2fb-4d34-9926-87b25bd25b58 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1364 microversion: 2.1 time: 0.147015 Jun 26 03:11:50.064373 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 385/777] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:49 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:50.604453 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2915c364-7b05-4b83-80db-26308a456eff tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:50.604959 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2915c364-7b05-4b83-80db-26308a456eff tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:50.611356 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2915c364-7b05-4b83-80db-26308a456eff tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:50.611812 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2915c364-7b05-4b83-80db-26308a456eff tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:50.612580 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2915c364-7b05-4b83-80db-26308a456eff tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:50.613020 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2915c364-7b05-4b83-80db-26308a456eff tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:50.693247 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.objects.instance [None req-2915c364-7b05-4b83-80db-26308a456eff tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lazy-loading 'services' on Instance uuid 473e061c-b6d3-4dff-9171-45f7acfaffee {{(pid=117783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:11:50.766933 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2915c364-7b05-4b83-80db-26308a456eff tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "DELETE /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-volume_attachments/20c918cc-3f6e-49aa-a1dc-3810fee01984" status: 202 len: 0 microversion: 2.1 time: 0.166159 Jun 26 03:11:50.770779 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 393/778] 10.222.0.13 () {58 vars in 1415 bytes} [Sun Jun 26 03:11:50 2022] DELETE /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-volume_attachments/20c918cc-3f6e-49aa-a1dc-3810fee01984 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:11:50.776547 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b3876bec-08e9-4fa1-8d8e-f3c776a8170b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:50.777904 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b3876bec-08e9-4fa1-8d8e-f3c776a8170b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:50.786301 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b3876bec-08e9-4fa1-8d8e-f3c776a8170b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:50.786900 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b3876bec-08e9-4fa1-8d8e-f3c776a8170b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:50.787689 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b3876bec-08e9-4fa1-8d8e-f3c776a8170b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:50.788306 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b3876bec-08e9-4fa1-8d8e-f3c776a8170b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:50.818641 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b3876bec-08e9-4fa1-8d8e-f3c776a8170b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046338 Jun 26 03:11:50.819136 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 386/779] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:11:50 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:11:51.081228 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4415c76f-4d39-4855-8fad-5bd578ff9fc8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:51.081845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4415c76f-4d39-4855-8fad-5bd578ff9fc8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:51.088150 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4415c76f-4d39-4855-8fad-5bd578ff9fc8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:51.088618 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4415c76f-4d39-4855-8fad-5bd578ff9fc8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:51.089361 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4415c76f-4d39-4855-8fad-5bd578ff9fc8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:51.089802 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4415c76f-4d39-4855-8fad-5bd578ff9fc8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:51.214762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4415c76f-4d39-4855-8fad-5bd578ff9fc8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:51.221958 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4415c76f-4d39-4855-8fad-5bd578ff9fc8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1364 microversion: 2.1 time: 0.145082 Jun 26 03:11:51.222537 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 394/780] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:51 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:51.830711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c4d3d36d-42a0-4c92-87c9-5aafaddc38fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:51.831635 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c4d3d36d-42a0-4c92-87c9-5aafaddc38fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:51.838611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c4d3d36d-42a0-4c92-87c9-5aafaddc38fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:51.839069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c4d3d36d-42a0-4c92-87c9-5aafaddc38fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:51.839835 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c4d3d36d-42a0-4c92-87c9-5aafaddc38fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:51.840275 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c4d3d36d-42a0-4c92-87c9-5aafaddc38fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:51.869489 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c4d3d36d-42a0-4c92-87c9-5aafaddc38fb tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042723 Jun 26 03:11:51.870075 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 387/781] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:11:51 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 26 03:11:51.936944 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c232ad55-0200-4dbc-8b67-f2418217d85c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:51.937454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c232ad55-0200-4dbc-8b67-f2418217d85c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:51.943965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c232ad55-0200-4dbc-8b67-f2418217d85c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:51.944426 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c232ad55-0200-4dbc-8b67-f2418217d85c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:51.945196 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c232ad55-0200-4dbc-8b67-f2418217d85c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:51.945694 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c232ad55-0200-4dbc-8b67-f2418217d85c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:51.970472 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c232ad55-0200-4dbc-8b67-f2418217d85c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:11:52.044271 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c232ad55-0200-4dbc-8b67-f2418217d85c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "DELETE /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 204 len: 0 microversion: 2.1 time: 0.110816 Jun 26 03:11:52.044775 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 395/782] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:11:51 2022] DELETE /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:11:52.054233 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-cff8a142-ec78-41af-a607-b89df23b0e97 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:52.054904 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-cff8a142-ec78-41af-a607-b89df23b0e97 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:52.060715 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cff8a142-ec78-41af-a607-b89df23b0e97 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:52.061161 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cff8a142-ec78-41af-a607-b89df23b0e97 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:52.061912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cff8a142-ec78-41af-a607-b89df23b0e97 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:52.062399 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cff8a142-ec78-41af-a607-b89df23b0e97 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:52.191437 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-cff8a142-ec78-41af-a607-b89df23b0e97 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:52.199347 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-cff8a142-ec78-41af-a607-b89df23b0e97 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1690 microversion: 2.1 time: 0.149086 Jun 26 03:11:52.199912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 388/783] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:52 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:52.238215 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f9eae238-4c36-4888-83f7-c2ef65fce101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:52.238916 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f9eae238-4c36-4888-83f7-c2ef65fce101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:52.244910 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9eae238-4c36-4888-83f7-c2ef65fce101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:52.245363 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9eae238-4c36-4888-83f7-c2ef65fce101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:52.246150 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9eae238-4c36-4888-83f7-c2ef65fce101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:52.246594 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9eae238-4c36-4888-83f7-c2ef65fce101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:52.372019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f9eae238-4c36-4888-83f7-c2ef65fce101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:52.379670 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f9eae238-4c36-4888-83f7-c2ef65fce101 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1364 microversion: 2.1 time: 0.145586 Jun 26 03:11:52.380244 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 396/784] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:52 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:52.765521 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-d09cb683-5879-446c-b26a-4adc388ec92c req-be25b21d-effd-49b5-a15f-fca13c8dcc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a783f9a-6fb1-478a-8b64-b4ed9830b33f", "name": "network-vif-plugged", "status": "completed", "tag": "98cb08d8-ef21-4ac4-a52f-3d665ef4ed53"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:11:52.774271 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-d09cb683-5879-446c-b26a-4adc388ec92c req-be25b21d-effd-49b5-a15f-fca13c8dcc34 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:52.774836 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-d09cb683-5879-446c-b26a-4adc388ec92c req-be25b21d-effd-49b5-a15f-fca13c8dcc34 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:52.789004 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-d09cb683-5879-446c-b26a-4adc388ec92c req-be25b21d-effd-49b5-a15f-fca13c8dcc34 service nova] Creating event network-vif-plugged:98cb08d8-ef21-4ac4-a52f-3d665ef4ed53 for instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f on hv-cinder-84684 Jun 26 03:11:52.794571 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-d09cb683-5879-446c-b26a-4adc388ec92c req-be25b21d-effd-49b5-a15f-fca13c8dcc34 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032655 Jun 26 03:11:52.795306 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 389/785] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:11:53.216653 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-824615cd-2c22-4bf1-93a7-dc49221d7e95 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:53.217261 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-824615cd-2c22-4bf1-93a7-dc49221d7e95 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:53.219695 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=6 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:53.225163 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-824615cd-2c22-4bf1-93a7-dc49221d7e95 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:53.225618 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-824615cd-2c22-4bf1-93a7-dc49221d7e95 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:53.226399 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-824615cd-2c22-4bf1-93a7-dc49221d7e95 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:53.226839 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-824615cd-2c22-4bf1-93a7-dc49221d7e95 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:53.360505 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-824615cd-2c22-4bf1-93a7-dc49221d7e95 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:53.368587 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-824615cd-2c22-4bf1-93a7-dc49221d7e95 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1690 microversion: 2.1 time: 0.155807 Jun 26 03:11:53.369162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 397/786] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:53 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:53.397066 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-00e84c09-bb81-4e20-90f7-2f057b19fad4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:53.397772 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-00e84c09-bb81-4e20-90f7-2f057b19fad4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:53.400554 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=2 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:53.400885 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=6 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:53.407441 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-00e84c09-bb81-4e20-90f7-2f057b19fad4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:53.407894 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-00e84c09-bb81-4e20-90f7-2f057b19fad4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:53.408665 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-00e84c09-bb81-4e20-90f7-2f057b19fad4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:53.409107 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-00e84c09-bb81-4e20-90f7-2f057b19fad4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:53.535704 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-00e84c09-bb81-4e20-90f7-2f057b19fad4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:53.544051 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-00e84c09-bb81-4e20-90f7-2f057b19fad4 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1364 microversion: 2.1 time: 0.150998 Jun 26 03:11:53.544642 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 390/787] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:53 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:54.385779 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-56b89015-6367-45ff-a083-a3e0ffb41ba7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:54.386442 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-56b89015-6367-45ff-a083-a3e0ffb41ba7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:54.392869 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-56b89015-6367-45ff-a083-a3e0ffb41ba7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:54.393323 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-56b89015-6367-45ff-a083-a3e0ffb41ba7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:54.394109 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-56b89015-6367-45ff-a083-a3e0ffb41ba7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:54.394550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-56b89015-6367-45ff-a083-a3e0ffb41ba7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:54.521620 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-56b89015-6367-45ff-a083-a3e0ffb41ba7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:54.528995 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-56b89015-6367-45ff-a083-a3e0ffb41ba7 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1690 microversion: 2.1 time: 0.147043 Jun 26 03:11:54.529551 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 398/788] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:54 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:54.561143 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6167c596-47f3-4947-a47d-e385d241b045 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:54.561757 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-6167c596-47f3-4947-a47d-e385d241b045 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:54.568217 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6167c596-47f3-4947-a47d-e385d241b045 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:54.568668 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6167c596-47f3-4947-a47d-e385d241b045 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:54.569430 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6167c596-47f3-4947-a47d-e385d241b045 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:54.569867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6167c596-47f3-4947-a47d-e385d241b045 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:54.703846 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-6167c596-47f3-4947-a47d-e385d241b045 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:54.713737 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6167c596-47f3-4947-a47d-e385d241b045 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1364 microversion: 2.1 time: 0.156220 Jun 26 03:11:54.714614 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 391/789] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:54 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:55.546217 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2a8683a0-44e4-4fe3-b273-c355d3fb872c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:55.546829 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2a8683a0-44e4-4fe3-b273-c355d3fb872c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:55.553299 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a8683a0-44e4-4fe3-b273-c355d3fb872c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:55.553751 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a8683a0-44e4-4fe3-b273-c355d3fb872c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:55.554551 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a8683a0-44e4-4fe3-b273-c355d3fb872c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:55.554989 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a8683a0-44e4-4fe3-b273-c355d3fb872c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:55.679854 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-2a8683a0-44e4-4fe3-b273-c355d3fb872c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:55.683378 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:55.688387 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2a8683a0-44e4-4fe3-b273-c355d3fb872c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1690 microversion: 2.1 time: 0.146036 Jun 26 03:11:55.688952 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 399/790] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:55 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:55.732253 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-38c47cd1-2c05-41ce-b27b-f724eed5b9e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:55.732871 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-38c47cd1-2c05-41ce-b27b-f724eed5b9e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:55.739297 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-38c47cd1-2c05-41ce-b27b-f724eed5b9e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:55.739752 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-38c47cd1-2c05-41ce-b27b-f724eed5b9e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:55.740518 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-38c47cd1-2c05-41ce-b27b-f724eed5b9e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:55.740959 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-38c47cd1-2c05-41ce-b27b-f724eed5b9e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:55.870455 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-38c47cd1-2c05-41ce-b27b-f724eed5b9e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:55.877935 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-38c47cd1-2c05-41ce-b27b-f724eed5b9e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1364 microversion: 2.1 time: 0.149498 Jun 26 03:11:55.878543 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 392/791] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:55 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:56.706325 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b605b3bd-9a1d-45e8-b185-9025a85781a2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:56.706934 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b605b3bd-9a1d-45e8-b185-9025a85781a2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:56.714003 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b605b3bd-9a1d-45e8-b185-9025a85781a2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:56.714522 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b605b3bd-9a1d-45e8-b185-9025a85781a2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:56.715286 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b605b3bd-9a1d-45e8-b185-9025a85781a2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:56.715729 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b605b3bd-9a1d-45e8-b185-9025a85781a2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:56.844186 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b605b3bd-9a1d-45e8-b185-9025a85781a2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:56.852318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b605b3bd-9a1d-45e8-b185-9025a85781a2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1690 microversion: 2.1 time: 0.150096 Jun 26 03:11:56.855406 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 400/792] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:56 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:56.895389 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7ea1575a-bccc-4167-b7f0-cc6544636aff tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:56.896143 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7ea1575a-bccc-4167-b7f0-cc6544636aff tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:56.902337 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7ea1575a-bccc-4167-b7f0-cc6544636aff tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:56.902868 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7ea1575a-bccc-4167-b7f0-cc6544636aff tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:56.903700 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7ea1575a-bccc-4167-b7f0-cc6544636aff tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:56.904214 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7ea1575a-bccc-4167-b7f0-cc6544636aff tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:57.033322 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7ea1575a-bccc-4167-b7f0-cc6544636aff tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:57.041298 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-7ea1575a-bccc-4167-b7f0-cc6544636aff tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1364 microversion: 2.1 time: 0.149811 Jun 26 03:11:57.041862 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 393/793] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:56 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:57.546290 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-8f77feaa-fc7f-48f0-a8d6-065f1b63b15c req-6ba72b1a-ab1d-4b02-8df5-5a7500cc8f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473e061c-b6d3-4dff-9171-45f7acfaffee", "name": "network-vif-deleted", "tag": "9ffa489f-38cb-4f25-9eb2-e940343d2383"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:11:57.554492 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-8f77feaa-fc7f-48f0-a8d6-065f1b63b15c req-6ba72b1a-ab1d-4b02-8df5-5a7500cc8f3c service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:57.554870 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-8f77feaa-fc7f-48f0-a8d6-065f1b63b15c req-6ba72b1a-ab1d-4b02-8df5-5a7500cc8f3c service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:57.565655 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-8f77feaa-fc7f-48f0-a8d6-065f1b63b15c req-6ba72b1a-ab1d-4b02-8df5-5a7500cc8f3c service nova] Creating event network-vif-deleted:9ffa489f-38cb-4f25-9eb2-e940343d2383 for instance 473e061c-b6d3-4dff-9171-45f7acfaffee on hv-cinder-84684 Jun 26 03:11:57.571026 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-8f77feaa-fc7f-48f0-a8d6-065f1b63b15c req-6ba72b1a-ab1d-4b02-8df5-5a7500cc8f3c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027786 Jun 26 03:11:57.571600 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 401/794] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:11:57.872173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9ae652bb-571b-47d6-858c-ecb3ab5a27fd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:57.872890 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9ae652bb-571b-47d6-858c-ecb3ab5a27fd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:57.881430 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ae652bb-571b-47d6-858c-ecb3ab5a27fd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:57.881887 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ae652bb-571b-47d6-858c-ecb3ab5a27fd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:57.882688 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ae652bb-571b-47d6-858c-ecb3ab5a27fd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:57.883741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ae652bb-571b-47d6-858c-ecb3ab5a27fd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:57.914102 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ae652bb-571b-47d6-858c-ecb3ab5a27fd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:57.914728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ae652bb-571b-47d6-858c-ecb3ab5a27fd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:57.914892 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-9ae652bb-571b-47d6-858c-ecb3ab5a27fd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lazy-loading 'fault' on Instance uuid 473e061c-b6d3-4dff-9171-45f7acfaffee {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:11:57.962357 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9ae652bb-571b-47d6-858c-ecb3ab5a27fd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:57.969977 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9ae652bb-571b-47d6-858c-ecb3ab5a27fd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 200 len: 1335 microversion: 2.1 time: 0.102456 Jun 26 03:11:57.970593 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 394/795] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:57 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:58.059493 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-551a1d8b-a9ec-4c9c-98cc-ab95b4967f12 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:58.060181 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-551a1d8b-a9ec-4c9c-98cc-ab95b4967f12 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:58.066308 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-551a1d8b-a9ec-4c9c-98cc-ab95b4967f12 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:58.066758 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-551a1d8b-a9ec-4c9c-98cc-ab95b4967f12 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:58.067522 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-551a1d8b-a9ec-4c9c-98cc-ab95b4967f12 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:58.067956 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-551a1d8b-a9ec-4c9c-98cc-ab95b4967f12 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:58.204546 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-551a1d8b-a9ec-4c9c-98cc-ab95b4967f12 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:11:58.212489 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-551a1d8b-a9ec-4c9c-98cc-ab95b4967f12 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1550 microversion: 2.1 time: 0.158109 Jun 26 03:11:58.216327 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 402/796] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:58 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:11:58.229376 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2d4983bf-0f47-4520-a290-311b2269117b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:58.230187 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2d4983bf-0f47-4520-a290-311b2269117b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:58.236410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2d4983bf-0f47-4520-a290-311b2269117b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:58.236862 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2d4983bf-0f47-4520-a290-311b2269117b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:58.237661 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2d4983bf-0f47-4520-a290-311b2269117b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:58.238207 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2d4983bf-0f47-4520-a290-311b2269117b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:58.334494 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2d4983bf-0f47-4520-a290-311b2269117b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109568 Jun 26 03:11:58.335122 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 395/797] 10.222.0.13 () {58 vars in 1274 bytes} [Sun Jun 26 03:11:58 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:11:58.986073 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-92ed5ab0-75a5-4766-b086-6c72fce45dda tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:58.986695 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-92ed5ab0-75a5-4766-b086-6c72fce45dda tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: 473e061c-b6d3-4dff-9171-45f7acfaffee] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:11:58.993488 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-92ed5ab0-75a5-4766-b086-6c72fce45dda tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:58.993946 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-92ed5ab0-75a5-4766-b086-6c72fce45dda tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:58.994739 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-92ed5ab0-75a5-4766-b086-6c72fce45dda tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:58.995233 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-92ed5ab0-75a5-4766-b086-6c72fce45dda tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:59.009038 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-92ed5ab0-75a5-4766-b086-6c72fce45dda tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] HTTP exception thrown: Instance 473e061c-b6d3-4dff-9171-45f7acfaffee could not be found. Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-92ed5ab0-75a5-4766-b086-6c72fce45dda tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Request method failure captured: Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee HTTP/1.1 Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zSuaVI5xGBKyt-ni0Q6VRanK0970QIQANht8SFYhxu6bIsUY6Gf98v9efGuB4_m7etgpFVQIiRT1YM4ymg0wjUqIXRNUniyVH783p5_8w9vV_EaiXGuCuSGWlSvG2V2PJ3CS0fR7hmPpRLXSI43DBw5gTc8Hdnlc6J3Fo1C2_HlFs Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: aa1dff9e9be549308ec0ad3a13810062 Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:11:59.010762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:11:59.012119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa1dff9e9be549308ec0ad3a13810062"}]}] Jun 26 03:11:59.012119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:11:59.012119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: aa1dff9e9be549308ec0ad3a13810062 Jun 26 03:11:59.012119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:11:59.012119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-ServerRescueNegativeTestJSON-1294839629-project Jun 26 03:11:59.012119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:11:59.012119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:11:59.012119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: a1313e0937b842059f1e01480c98351c Jun 26 03:11:59.012119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1294839629-project Jun 26 03:11:59.012119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:11:59.012119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 473e061c-b6d3-4dff-9171-45f7acfaffee could not be found. Jun 26 03:11:59.012119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '473e061c-b6d3-4dff-9171-45f7acfaffee'} Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 473e061c-b6d3-4dff-9171-45f7acfaffee could not be found. Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:11:59.012837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 473e061c-b6d3-4dff-9171-45f7acfaffee could not be found. Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 473e061c-b6d3-4dff-9171-45f7acfaffee could not be found. Jun 26 03:11:59.013965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:11:59.015249 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-92ed5ab0-75a5-4766-b086-6c72fce45dda tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Returning 404 to user: Instance 473e061c-b6d3-4dff-9171-45f7acfaffee could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:11:59.015249 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-92ed5ab0-75a5-4766-b086-6c72fce45dda tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee" status: 404 len: 111 microversion: 2.1 time: 0.030137 Jun 26 03:11:59.015249 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 403/798] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:11:58 2022] GET /compute/v2.1/servers/473e061c-b6d3-4dff-9171-45f7acfaffee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:11:59.023045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-805b332f-3ebd-4744-a19c-0a8b90870ab9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '.version_select at 0x7f58275dfc10>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:11:59.040123 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-805b332f-3ebd-4744-a19c-0a8b90870ab9 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422837008" status: 202 len: 0 microversion: 2.1 time: 0.021248 Jun 26 03:11:59.040788 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 396/799] 10.222.0.13 () {58 vars in 1220 bytes} [Sun Jun 26 03:11:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422837008 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:11:59.270522 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-139c85b1-e943-4ec1-9fcb-b6b13d265f58 req-efdaf364-4918-455e-b92b-948a31b26fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a783f9a-6fb1-478a-8b64-b4ed9830b33f", "tag": "98cb08d8-ef21-4ac4-a52f-3d665ef4ed53"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:11:59.279526 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-139c85b1-e943-4ec1-9fcb-b6b13d265f58 req-efdaf364-4918-455e-b92b-948a31b26fad service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:11:59.279968 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-139c85b1-e943-4ec1-9fcb-b6b13d265f58 req-efdaf364-4918-455e-b92b-948a31b26fad service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:11:59.292262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-139c85b1-e943-4ec1-9fcb-b6b13d265f58 req-efdaf364-4918-455e-b92b-948a31b26fad service nova] Creating event network-changed:98cb08d8-ef21-4ac4-a52f-3d665ef4ed53 for instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f on hv-cinder-84684 Jun 26 03:11:59.298085 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-139c85b1-e943-4ec1-9fcb-b6b13d265f58 req-efdaf364-4918-455e-b92b-948a31b26fad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031059 Jun 26 03:11:59.299234 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 404/800] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:12:02.424891 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-0259e905-0a4f-4c06-b240-25115873bfbd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:02.425388 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-0259e905-0a4f-4c06-b240-25115873bfbd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:02.431815 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0259e905-0a4f-4c06-b240-25115873bfbd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:02.432272 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0259e905-0a4f-4c06-b240-25115873bfbd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:02.433027 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0259e905-0a4f-4c06-b240-25115873bfbd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:02.433462 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0259e905-0a4f-4c06-b240-25115873bfbd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:02.450768 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=100 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:12:02.458700 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-0259e905-0a4f-4c06-b240-25115873bfbd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Going to try to terminate instance {{(pid=117782) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:12:02.534067 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-0259e905-0a4f-4c06-b240-25115873bfbd tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 204 len: 0 microversion: 2.1 time: 0.112638 Jun 26 03:12:02.534856 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 397/801] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:12:02 2022] DELETE /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:12:02.544526 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fb857a28-5add-4ca0-a8ee-69661d18e20a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:02.545229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fb857a28-5add-4ca0-a8ee-69661d18e20a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:02.551470 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb857a28-5add-4ca0-a8ee-69661d18e20a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:02.551926 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb857a28-5add-4ca0-a8ee-69661d18e20a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:02.552692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb857a28-5add-4ca0-a8ee-69661d18e20a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:02.553135 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb857a28-5add-4ca0-a8ee-69661d18e20a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:02.681865 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fb857a28-5add-4ca0-a8ee-69661d18e20a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:02.689255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fb857a28-5add-4ca0-a8ee-69661d18e20a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1507 microversion: 2.1 time: 0.150257 Jun 26 03:12:02.690072 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 405/802] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:12:02 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:12:03.708419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3857fbca-1779-479f-874e-b45de752584c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:03.709028 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3857fbca-1779-479f-874e-b45de752584c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:03.716084 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3857fbca-1779-479f-874e-b45de752584c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:03.716536 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3857fbca-1779-479f-874e-b45de752584c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:03.717296 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3857fbca-1779-479f-874e-b45de752584c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:03.717738 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3857fbca-1779-479f-874e-b45de752584c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:03.787422 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-3857fbca-1779-479f-874e-b45de752584c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:03.799676 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3857fbca-1779-479f-874e-b45de752584c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 200 len: 1465 microversion: 2.1 time: 0.095238 Jun 26 03:12:03.809855 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 398/803] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:12:03 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 1465 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:12:03.848309 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-c696e8a8-390c-4bec-a7fe-c3ee4aa4a408 req-bf5cc712-6577-47c2-9987-ed6923112aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b753d813-95df-4256-a8c0-dcd4681dfe27", "name": "network-vif-deleted", "tag": "343e4080-88b4-47fd-8dd1-6b13277216f9"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:12:03.858071 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-c696e8a8-390c-4bec-a7fe-c3ee4aa4a408 req-bf5cc712-6577-47c2-9987-ed6923112aea service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:03.858545 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-c696e8a8-390c-4bec-a7fe-c3ee4aa4a408 req-bf5cc712-6577-47c2-9987-ed6923112aea service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:03.870863 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-c696e8a8-390c-4bec-a7fe-c3ee4aa4a408 req-bf5cc712-6577-47c2-9987-ed6923112aea service nova] Creating event network-vif-deleted:343e4080-88b4-47fd-8dd1-6b13277216f9 for instance b753d813-95df-4256-a8c0-dcd4681dfe27 on hv-cinder-84684 Jun 26 03:12:03.876067 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-c696e8a8-390c-4bec-a7fe-c3ee4aa4a408 req-bf5cc712-6577-47c2-9987-ed6923112aea service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032022 Jun 26 03:12:03.877241 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 406/804] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:12:04.817487 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8c001dd4-6968-425c-91a1-0243e9bd49ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:04.818137 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8c001dd4-6968-425c-91a1-0243e9bd49ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: b753d813-95df-4256-a8c0-dcd4681dfe27] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:04.825036 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8c001dd4-6968-425c-91a1-0243e9bd49ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:04.825488 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8c001dd4-6968-425c-91a1-0243e9bd49ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:04.826273 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8c001dd4-6968-425c-91a1-0243e9bd49ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:04.826710 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8c001dd4-6968-425c-91a1-0243e9bd49ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:04.840789 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-8c001dd4-6968-425c-91a1-0243e9bd49ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] HTTP exception thrown: Instance b753d813-95df-4256-a8c0-dcd4681dfe27 could not be found. Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8c001dd4-6968-425c-91a1-0243e9bd49ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Request method failure captured: Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 HTTP/1.1 Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zSuaVI5xGBKyt-ni0Q6VRanK0970QIQANht8SFYhxu6bIsUY6Gf98v9efGuB4_m7etgpFVQIiRT1YM4ymg0wjUqIXRNUniyVH783p5_8w9vV_EaiXGuCuSGWlSvG2V2PJ3CS0fR7hmPpRLXSI43DBw5gTc8Hdnlc6J3Fo1C2_HlFs Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: aa1dff9e9be549308ec0ad3a13810062 Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:12:04.842448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:12:04.843972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa1dff9e9be549308ec0ad3a13810062"}]}] Jun 26 03:12:04.843972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:12:04.843972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: aa1dff9e9be549308ec0ad3a13810062 Jun 26 03:12:04.843972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:12:04.843972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-ServerRescueNegativeTestJSON-1294839629-project Jun 26 03:12:04.843972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:12:04.843972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:12:04.843972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: a1313e0937b842059f1e01480c98351c Jun 26 03:12:04.843972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1294839629-project Jun 26 03:12:04.843972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:12:04.843972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance b753d813-95df-4256-a8c0-dcd4681dfe27 could not be found. Jun 26 03:12:04.843972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': 'b753d813-95df-4256-a8c0-dcd4681dfe27'} Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b753d813-95df-4256-a8c0-dcd4681dfe27 could not be found. Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:12:04.844870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b753d813-95df-4256-a8c0-dcd4681dfe27 could not be found. Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b753d813-95df-4256-a8c0-dcd4681dfe27 could not be found. Jun 26 03:12:04.846484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:04.848015 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8c001dd4-6968-425c-91a1-0243e9bd49ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Returning 404 to user: Instance b753d813-95df-4256-a8c0-dcd4681dfe27 could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:12:04.848015 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8c001dd4-6968-425c-91a1-0243e9bd49ca tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27" status: 404 len: 111 microversion: 2.1 time: 0.030998 Jun 26 03:12:04.848015 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 399/805] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:12:04 2022] GET /compute/v2.1/servers/b753d813-95df-4256-a8c0-dcd4681dfe27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:12:04.852825 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-95ea74c4-a51b-4a59-9497-3383f716930c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:04.853419 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-95ea74c4-a51b-4a59-9497-3383f716930c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:04.860187 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-95ea74c4-a51b-4a59-9497-3383f716930c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:04.860654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-95ea74c4-a51b-4a59-9497-3383f716930c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:04.861434 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-95ea74c4-a51b-4a59-9497-3383f716930c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:04.861882 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-95ea74c4-a51b-4a59-9497-3383f716930c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:04.887375 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-95ea74c4-a51b-4a59-9497-3383f716930c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:12:04.960568 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-95ea74c4-a51b-4a59-9497-3383f716930c tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 204 len: 0 microversion: 2.1 time: 0.111605 Jun 26 03:12:04.961898 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 407/806] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:12:04 2022] DELETE /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:12:04.970080 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-94c91452-ed3b-4f6a-b838-d0f0f0ac0b7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:04.970697 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-94c91452-ed3b-4f6a-b838-d0f0f0ac0b7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:04.976857 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94c91452-ed3b-4f6a-b838-d0f0f0ac0b7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:04.977313 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94c91452-ed3b-4f6a-b838-d0f0f0ac0b7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:04.978139 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94c91452-ed3b-4f6a-b838-d0f0f0ac0b7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:04.978587 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94c91452-ed3b-4f6a-b838-d0f0f0ac0b7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:05.105664 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-94c91452-ed3b-4f6a-b838-d0f0f0ac0b7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:05.113122 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-94c91452-ed3b-4f6a-b838-d0f0f0ac0b7b tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.146996 Jun 26 03:12:05.113682 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 400/807] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:12:04 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:12:06.130792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6c3f0246-0223-4ee1-a26f-3d65e2ccd16a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:06.131485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-6c3f0246-0223-4ee1-a26f-3d65e2ccd16a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:06.137898 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6c3f0246-0223-4ee1-a26f-3d65e2ccd16a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:06.138376 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6c3f0246-0223-4ee1-a26f-3d65e2ccd16a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:06.139133 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6c3f0246-0223-4ee1-a26f-3d65e2ccd16a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:06.139569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6c3f0246-0223-4ee1-a26f-3d65e2ccd16a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:06.263900 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6c3f0246-0223-4ee1-a26f-3d65e2ccd16a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:06.271199 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6c3f0246-0223-4ee1-a26f-3d65e2ccd16a tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.144921 Jun 26 03:12:06.271756 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 408/808] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:12:06 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:12:07.288585 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fc0011f8-6c2c-4bda-886c-5f5ada5927e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:07.289697 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-fc0011f8-6c2c-4bda-886c-5f5ada5927e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:07.292131 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:12:07.297388 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fc0011f8-6c2c-4bda-886c-5f5ada5927e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:07.297836 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fc0011f8-6c2c-4bda-886c-5f5ada5927e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:07.298621 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fc0011f8-6c2c-4bda-886c-5f5ada5927e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:07.299059 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fc0011f8-6c2c-4bda-886c-5f5ada5927e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:07.428840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-fc0011f8-6c2c-4bda-886c-5f5ada5927e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:07.436900 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-fc0011f8-6c2c-4bda-886c-5f5ada5927e2 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1522 microversion: 2.1 time: 0.152171 Jun 26 03:12:07.437463 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 401/809] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:12:07 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:12:08.191317 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-d4f11c63-69f8-4a43-9508-83cb1cbb40d7 req-40320d39-268d-46b7-a0b8-db74ad8c96a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cddc852a-2aa2-4a44-ad1a-e9e930e3bddf", "name": "network-vif-deleted", "tag": "634b866a-e4dd-43d0-84a2-3a0a964abbff"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:12:08.196810 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:12:08.203767 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-d4f11c63-69f8-4a43-9508-83cb1cbb40d7 req-40320d39-268d-46b7-a0b8-db74ad8c96a0 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:08.204245 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-d4f11c63-69f8-4a43-9508-83cb1cbb40d7 req-40320d39-268d-46b7-a0b8-db74ad8c96a0 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:08.218134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-d4f11c63-69f8-4a43-9508-83cb1cbb40d7 req-40320d39-268d-46b7-a0b8-db74ad8c96a0 service nova] Creating event network-vif-deleted:634b866a-e4dd-43d0-84a2-3a0a964abbff for instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf on hv-cinder-84684 Jun 26 03:12:08.223937 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-d4f11c63-69f8-4a43-9508-83cb1cbb40d7 req-40320d39-268d-46b7-a0b8-db74ad8c96a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036946 Jun 26 03:12:08.224614 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 409/810] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:12:08.453867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-35099679-67ab-43db-89dd-fa01920e045e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:08.454434 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-35099679-67ab-43db-89dd-fa01920e045e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:08.464989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-35099679-67ab-43db-89dd-fa01920e045e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:08.465760 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-35099679-67ab-43db-89dd-fa01920e045e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:08.467134 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-35099679-67ab-43db-89dd-fa01920e045e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:08.467816 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-35099679-67ab-43db-89dd-fa01920e045e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:08.502840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-35099679-67ab-43db-89dd-fa01920e045e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:08.503292 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-35099679-67ab-43db-89dd-fa01920e045e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:08.503744 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-35099679-67ab-43db-89dd-fa01920e045e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lazy-loading 'fault' on Instance uuid cddc852a-2aa2-4a44-ad1a-e9e930e3bddf {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:12:08.545491 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-35099679-67ab-43db-89dd-fa01920e045e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1313e0937b842059f1e01480c98351c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1dff9e9be549308ec0ad3a13810062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:08.553649 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-35099679-67ab-43db-89dd-fa01920e045e tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 200 len: 1312 microversion: 2.1 time: 0.103788 Jun 26 03:12:08.554450 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 402/811] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:12:08 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:12:09.571654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-263668f3-91dc-4cf6-8a37-25bb5bbb81c5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:09.572315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-263668f3-91dc-4cf6-8a37-25bb5bbb81c5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] [instance: cddc852a-2aa2-4a44-ad1a-e9e930e3bddf] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:09.578544 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-263668f3-91dc-4cf6-8a37-25bb5bbb81c5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:09.579004 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-263668f3-91dc-4cf6-8a37-25bb5bbb81c5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:09.579786 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-263668f3-91dc-4cf6-8a37-25bb5bbb81c5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:09.580233 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-263668f3-91dc-4cf6-8a37-25bb5bbb81c5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:09.593074 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-263668f3-91dc-4cf6-8a37-25bb5bbb81c5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] HTTP exception thrown: Instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf could not be found. Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-263668f3-91dc-4cf6-8a37-25bb5bbb81c5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Request method failure captured: Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf HTTP/1.1 Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zSuaVI5xGBKyt-ni0Q6VRanK0970QIQANht8SFYhxu6bIsUY6Gf98v9efGuB4_m7etgpFVQIiRT1YM4ymg0wjUqIXRNUniyVH783p5_8w9vV_EaiXGuCuSGWlSvG2V2PJ3CS0fR7hmPpRLXSI43DBw5gTc8Hdnlc6J3Fo1C2_HlFs Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: aa1dff9e9be549308ec0ad3a13810062 Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:12:09.594692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:12:09.596162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa1dff9e9be549308ec0ad3a13810062"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa1dff9e9be549308ec0ad3a13810062"}]}] Jun 26 03:12:09.596162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:12:09.596162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: aa1dff9e9be549308ec0ad3a13810062 Jun 26 03:12:09.596162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1294839629 Jun 26 03:12:09.596162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-ServerRescueNegativeTestJSON-1294839629-project Jun 26 03:12:09.596162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:12:09.596162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:12:09.596162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: a1313e0937b842059f1e01480c98351c Jun 26 03:12:09.596162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1294839629-project Jun 26 03:12:09.596162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:12:09.596162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf could not be found. Jun 26 03:12:09.596162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': 'cddc852a-2aa2-4a44-ad1a-e9e930e3bddf'} Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf could not be found. Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:12:09.597019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf could not be found. Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf could not be found. Jun 26 03:12:09.598420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:12:09.599652 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-263668f3-91dc-4cf6-8a37-25bb5bbb81c5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] Returning 404 to user: Instance cddc852a-2aa2-4a44-ad1a-e9e930e3bddf could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:12:09.599652 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-263668f3-91dc-4cf6-8a37-25bb5bbb81c5 tempest-ServerRescueNegativeTestJSON-1294839629 tempest-ServerRescueNegativeTestJSON-1294839629-project] 10.222.0.13 "GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf" status: 404 len: 111 microversion: 2.1 time: 0.029225 Jun 26 03:12:09.599652 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 410/812] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:12:09 2022] GET /compute/v2.1/servers/cddc852a-2aa2-4a44-ad1a-e9e930e3bddf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:12:42.802532 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f538bba8-888e-4d1b-856b-533a304ce5d9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:42.803128 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f538bba8-888e-4d1b-856b-533a304ce5d9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:42.805082 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=5 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:12:42.805727 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:12:42.812090 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f538bba8-888e-4d1b-856b-533a304ce5d9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:42.812543 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f538bba8-888e-4d1b-856b-533a304ce5d9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:42.813316 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f538bba8-888e-4d1b-856b-533a304ce5d9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:42.813752 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f538bba8-888e-4d1b-856b-533a304ce5d9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:42.838736 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f538bba8-888e-4d1b-856b-533a304ce5d9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/ips" status: 200 len: 149 microversion: 2.1 time: 0.040195 Jun 26 03:12:42.839224 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 403/813] 10.222.0.13 () {58 vars in 1247 bytes} [Sun Jun 26 03:12:42 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:12:43.034284 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-bc1cd6ba-b61c-4562-acc9-0a93372323e6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:43.034800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-bc1cd6ba-b61c-4562-acc9-0a93372323e6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:43.037126 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:12:43.037914 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:12:43.044972 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc1cd6ba-b61c-4562-acc9-0a93372323e6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:43.045666 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc1cd6ba-b61c-4562-acc9-0a93372323e6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:43.046605 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc1cd6ba-b61c-4562-acc9-0a93372323e6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:43.047211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc1cd6ba-b61c-4562-acc9-0a93372323e6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:43.074266 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-bc1cd6ba-b61c-4562-acc9-0a93372323e6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/ips" status: 200 len: 152 microversion: 2.20 time: 0.044221 Jun 26 03:12:43.074838 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 411/814] 10.222.0.13 () {60 vars in 1288 bytes} [Sun Jun 26 03:12:43 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 03:12:45.233502 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-349c4d3c-a0d8-4d00-94f1-532a892d4127 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90816124-9298-4f7f-adcb-4f8d78d294db"}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:12:45.234653 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-349c4d3c-a0d8-4d00-94f1-532a892d4127 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:45.240511 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-349c4d3c-a0d8-4d00-94f1-532a892d4127 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:45.240960 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-349c4d3c-a0d8-4d00-94f1-532a892d4127 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:45.241710 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-349c4d3c-a0d8-4d00-94f1-532a892d4127 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:45.242182 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-349c4d3c-a0d8-4d00-94f1-532a892d4127 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:45.497319 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-349c4d3c-a0d8-4d00-94f1-532a892d4127 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "POST /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267574 Jun 26 03:12:45.497908 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 404/815] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:12:45 2022] POST /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:12:45.936510 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fdbea32b-d5e9-4824-b458-28fcd16a43b6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:12:45.937025 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fdbea32b-d5e9-4824-b458-28fcd16a43b6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:45.943447 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fdbea32b-d5e9-4824-b458-28fcd16a43b6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:45.943898 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fdbea32b-d5e9-4824-b458-28fcd16a43b6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:45.944650 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fdbea32b-d5e9-4824-b458-28fcd16a43b6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:45.945081 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fdbea32b-d5e9-4824-b458-28fcd16a43b6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:45.967437 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.objects.instance [None req-fdbea32b-d5e9-4824-b458-28fcd16a43b6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lazy-loading 'flavor' on Instance uuid ee71e3f2-a415-4000-97d4-290a4675ee4e {{(pid=117783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:12:46.234121 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fdbea32b-d5e9-4824-b458-28fcd16a43b6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "POST /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/action" status: 202 len: 0 microversion: 2.20 time: 0.301424 Jun 26 03:12:46.235886 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 412/816] 10.222.0.13 () {62 vars in 1318 bytes} [Sun Jun 26 03:12:45 2022] POST /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:12:46.245955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8cce3bbf-2dd8-4869-81a3-c443de75352d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:46.247337 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8cce3bbf-2dd8-4869-81a3-c443de75352d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:46.254423 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8cce3bbf-2dd8-4869-81a3-c443de75352d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:46.255304 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8cce3bbf-2dd8-4869-81a3-c443de75352d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:46.256323 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8cce3bbf-2dd8-4869-81a3-c443de75352d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:46.256975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8cce3bbf-2dd8-4869-81a3-c443de75352d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:46.396662 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8cce3bbf-2dd8-4869-81a3-c443de75352d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:46.404740 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8cce3bbf-2dd8-4869-81a3-c443de75352d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:46.406289 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8cce3bbf-2dd8-4869-81a3-c443de75352d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:46.407469 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8cce3bbf-2dd8-4869-81a3-c443de75352d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.168220 Jun 26 03:12:46.408040 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 405/817] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:12:46 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:12:47.426960 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-001f11f8-c6e1-4d61-930e-19c706e94f7b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:47.427664 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-001f11f8-c6e1-4d61-930e-19c706e94f7b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:47.433957 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-001f11f8-c6e1-4d61-930e-19c706e94f7b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:47.434448 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-001f11f8-c6e1-4d61-930e-19c706e94f7b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:47.435217 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-001f11f8-c6e1-4d61-930e-19c706e94f7b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:47.435659 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-001f11f8-c6e1-4d61-930e-19c706e94f7b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:47.564225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-001f11f8-c6e1-4d61-930e-19c706e94f7b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:47.572591 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-001f11f8-c6e1-4d61-930e-19c706e94f7b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:47.574142 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-001f11f8-c6e1-4d61-930e-19c706e94f7b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:47.575306 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-001f11f8-c6e1-4d61-930e-19c706e94f7b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.153065 Jun 26 03:12:47.575863 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 413/818] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:12:47 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:12:48.593155 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b2b27554-a949-4def-8821-3c581e0a638e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:48.593779 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b2b27554-a949-4def-8821-3c581e0a638e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:48.600373 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b2b27554-a949-4def-8821-3c581e0a638e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:48.600839 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b2b27554-a949-4def-8821-3c581e0a638e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:48.601603 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b2b27554-a949-4def-8821-3c581e0a638e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:48.602064 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b2b27554-a949-4def-8821-3c581e0a638e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:48.734058 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b2b27554-a949-4def-8821-3c581e0a638e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:48.742082 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b2b27554-a949-4def-8821-3c581e0a638e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:48.743599 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b2b27554-a949-4def-8821-3c581e0a638e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:48.744763 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b2b27554-a949-4def-8821-3c581e0a638e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.155491 Jun 26 03:12:48.745320 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 406/819] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:12:48 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:12:49.763557 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-82853a83-cb16-40d8-ab1c-670c36e38636 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:49.764193 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-82853a83-cb16-40d8-ab1c-670c36e38636 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:49.770541 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-82853a83-cb16-40d8-ab1c-670c36e38636 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:49.770997 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-82853a83-cb16-40d8-ab1c-670c36e38636 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:49.771766 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-82853a83-cb16-40d8-ab1c-670c36e38636 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:49.772207 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-82853a83-cb16-40d8-ab1c-670c36e38636 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:49.901194 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-82853a83-cb16-40d8-ab1c-670c36e38636 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:49.909041 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-82853a83-cb16-40d8-ab1c-670c36e38636 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:49.910609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-82853a83-cb16-40d8-ab1c-670c36e38636 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:49.911772 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-82853a83-cb16-40d8-ab1c-670c36e38636 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.152637 Jun 26 03:12:49.912305 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 414/820] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:12:49 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:12:50.930474 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-686eb4e5-c6b0-449a-ab57-ab56dd1657ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:50.931092 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-686eb4e5-c6b0-449a-ab57-ab56dd1657ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:50.938158 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-686eb4e5-c6b0-449a-ab57-ab56dd1657ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:50.938616 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-686eb4e5-c6b0-449a-ab57-ab56dd1657ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:50.939386 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-686eb4e5-c6b0-449a-ab57-ab56dd1657ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:50.939829 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-686eb4e5-c6b0-449a-ab57-ab56dd1657ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:51.068043 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-686eb4e5-c6b0-449a-ab57-ab56dd1657ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:51.076519 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-686eb4e5-c6b0-449a-ab57-ab56dd1657ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:51.078016 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-686eb4e5-c6b0-449a-ab57-ab56dd1657ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:51.079172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-686eb4e5-c6b0-449a-ab57-ab56dd1657ea tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.152639 Jun 26 03:12:51.079723 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 407/821] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:12:50 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:12:52.096639 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fd783268-267d-4b12-b630-e04f62a3bdbb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:52.097277 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fd783268-267d-4b12-b630-e04f62a3bdbb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:52.103812 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fd783268-267d-4b12-b630-e04f62a3bdbb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:52.104267 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fd783268-267d-4b12-b630-e04f62a3bdbb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:52.105029 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fd783268-267d-4b12-b630-e04f62a3bdbb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:52.105470 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fd783268-267d-4b12-b630-e04f62a3bdbb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:52.240325 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fd783268-267d-4b12-b630-e04f62a3bdbb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:52.248334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fd783268-267d-4b12-b630-e04f62a3bdbb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:52.249846 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fd783268-267d-4b12-b630-e04f62a3bdbb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:52.251027 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fd783268-267d-4b12-b630-e04f62a3bdbb tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.158279 Jun 26 03:12:52.251776 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 415/822] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:12:52 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:12:52.975960 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e6eb0d30-1766-46a2-a777-c2c79d81f3ab tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90816124-9298-4f7f-adcb-4f8d78d294db"}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:12:52.977087 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e6eb0d30-1766-46a2-a777-c2c79d81f3ab tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:52.984113 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e6eb0d30-1766-46a2-a777-c2c79d81f3ab tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:52.984520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e6eb0d30-1766-46a2-a777-c2c79d81f3ab tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:52.985284 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e6eb0d30-1766-46a2-a777-c2c79d81f3ab tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:52.985727 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e6eb0d30-1766-46a2-a777-c2c79d81f3ab tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:53.061608 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-e6eb0d30-1766-46a2-a777-c2c79d81f3ab tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Invalid volume: volume 90816124-9298-4f7f-adcb-4f8d78d294db is already attached to instances: 16b07d92-79ab-4155-972b-7619661bd1d2 Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e6eb0d30-1766-46a2-a777-c2c79d81f3ab tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: POST /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/os-volume_attachments HTTP/1.1 Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 74 Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:12:53.063354 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:12:53.064990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:12:53.064990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:12:53.064990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:12:53.064990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:12:53.064990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:12:53.064990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:12:53.064990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:12:53.064990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:12:53.064990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:12:53.064990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Jun 26 03:12:53.064990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {"volumeAttachment": {"volumeId": "90816124-9298-4f7f-adcb-4f8d78d294db"}} Jun 26 03:12:53.064990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Invalid volume: volume 90816124-9298-4f7f-adcb-4f8d78d294db is already attached to instances: 16b07d92-79ab-4155-972b-7619661bd1d2 Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'server_id': '16b07d92-79ab-4155-972b-7619661bd1d2', 'body': {'volumeAttachment': {'volumeId': '90816124-9298-4f7f-adcb-4f8d78d294db'}}} Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 90816124-9298-4f7f-adcb-4f8d78d294db is already attached to instances: 16b07d92-79ab-4155-972b-7619661bd1d2 Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:53.065947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 90816124-9298-4f7f-adcb-4f8d78d294db is already attached to instances: 16b07d92-79ab-4155-972b-7619661bd1d2 Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:12:53.067371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:12:53.068843 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:12:53.068843 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:12:53.068843 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:12:53.068843 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 90816124-9298-4f7f-adcb-4f8d78d294db is already attached to instances: 16b07d92-79ab-4155-972b-7619661bd1d2 Jun 26 03:12:53.068843 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:53.068843 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e6eb0d30-1766-46a2-a777-c2c79d81f3ab tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 400 to user: Invalid volume: volume 90816124-9298-4f7f-adcb-4f8d78d294db is already attached to instances: 16b07d92-79ab-4155-972b-7619661bd1d2 {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:12:53.068843 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e6eb0d30-1766-46a2-a777-c2c79d81f3ab tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "POST /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092807 Jun 26 03:12:53.068843 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 408/823] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:12:52 2022] POST /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 26 03:12:53.124967 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3ac57c48-9fc8-427b-8524-e5808e6fe32f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:53.125464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3ac57c48-9fc8-427b-8524-e5808e6fe32f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:53.132305 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3ac57c48-9fc8-427b-8524-e5808e6fe32f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:53.132669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3ac57c48-9fc8-427b-8524-e5808e6fe32f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:53.133433 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3ac57c48-9fc8-427b-8524-e5808e6fe32f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:53.133951 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3ac57c48-9fc8-427b-8524-e5808e6fe32f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:53.212450 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.objects.instance [None req-3ac57c48-9fc8-427b-8524-e5808e6fe32f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lazy-loading 'services' on Instance uuid 16b07d92-79ab-4155-972b-7619661bd1d2 {{(pid=117783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:12:53.270640 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-22105b92-94d3-448d-92cb-73949a0fc521 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:53.271260 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-22105b92-94d3-448d-92cb-73949a0fc521 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:53.278212 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-22105b92-94d3-448d-92cb-73949a0fc521 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:53.278591 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-22105b92-94d3-448d-92cb-73949a0fc521 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:53.279681 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-22105b92-94d3-448d-92cb-73949a0fc521 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:53.279855 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-22105b92-94d3-448d-92cb-73949a0fc521 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:53.286014 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3ac57c48-9fc8-427b-8524-e5808e6fe32f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/os-volume_attachments/90816124-9298-4f7f-adcb-4f8d78d294db" status: 202 len: 0 microversion: 2.1 time: 0.163103 Jun 26 03:12:53.289864 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 416/824] 10.222.0.13 () {58 vars in 1415 bytes} [Sun Jun 26 03:12:53 2022] DELETE /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/os-volume_attachments/90816124-9298-4f7f-adcb-4f8d78d294db => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 26 03:12:53.302746 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d49fbe54-aab3-46c7-b066-6187f97ac7fd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:53.303832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d49fbe54-aab3-46c7-b066-6187f97ac7fd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:53.310322 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d49fbe54-aab3-46c7-b066-6187f97ac7fd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:53.310802 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d49fbe54-aab3-46c7-b066-6187f97ac7fd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:53.311574 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d49fbe54-aab3-46c7-b066-6187f97ac7fd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:53.312006 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d49fbe54-aab3-46c7-b066-6187f97ac7fd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:53.342770 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d49fbe54-aab3-46c7-b066-6187f97ac7fd tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045087 Jun 26 03:12:53.343330 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 417/825] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:12:53 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:12:53.413919 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-22105b92-94d3-448d-92cb-73949a0fc521 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:53.422451 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-22105b92-94d3-448d-92cb-73949a0fc521 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:53.423952 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-22105b92-94d3-448d-92cb-73949a0fc521 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:53.425096 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-22105b92-94d3-448d-92cb-73949a0fc521 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.158401 Jun 26 03:12:53.425644 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 409/826] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:12:53 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:12:54.354740 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0e9b6524-0fe6-4ce5-b781-411dbe394b95 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:54.355660 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0e9b6524-0fe6-4ce5-b781-411dbe394b95 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:54.362028 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0e9b6524-0fe6-4ce5-b781-411dbe394b95 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:54.362512 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0e9b6524-0fe6-4ce5-b781-411dbe394b95 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:54.363277 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0e9b6524-0fe6-4ce5-b781-411dbe394b95 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:54.363716 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0e9b6524-0fe6-4ce5-b781-411dbe394b95 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:54.393602 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0e9b6524-0fe6-4ce5-b781-411dbe394b95 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043219 Jun 26 03:12:54.394185 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 418/827] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:12:54 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 26 03:12:54.443183 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b492911e-25c0-44fa-8e35-1d5d9d783a73 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:54.443912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b492911e-25c0-44fa-8e35-1d5d9d783a73 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:54.450525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b492911e-25c0-44fa-8e35-1d5d9d783a73 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:54.451087 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b492911e-25c0-44fa-8e35-1d5d9d783a73 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:54.451653 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e26e1bdc-6816-4a5a-a8c3-3bff1bf57785 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:54.452145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b492911e-25c0-44fa-8e35-1d5d9d783a73 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:54.452263 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e26e1bdc-6816-4a5a-a8c3-3bff1bf57785 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:54.452701 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b492911e-25c0-44fa-8e35-1d5d9d783a73 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:54.458179 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e26e1bdc-6816-4a5a-a8c3-3bff1bf57785 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:54.458639 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e26e1bdc-6816-4a5a-a8c3-3bff1bf57785 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:54.459427 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e26e1bdc-6816-4a5a-a8c3-3bff1bf57785 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:54.459860 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e26e1bdc-6816-4a5a-a8c3-3bff1bf57785 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:54.486667 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e26e1bdc-6816-4a5a-a8c3-3bff1bf57785 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:12:54.589020 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e26e1bdc-6816-4a5a-a8c3-3bff1bf57785 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 204 len: 0 microversion: 2.1 time: 0.140714 Jun 26 03:12:54.593800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 419/828] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:12:54 2022] DELETE /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 26 03:12:54.599861 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4d258564-8f34-4887-8e74-39877a6a579b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:54.600553 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4d258564-8f34-4887-8e74-39877a6a579b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:54.606740 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b492911e-25c0-44fa-8e35-1d5d9d783a73 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:54.608646 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d258564-8f34-4887-8e74-39877a6a579b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:54.609102 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d258564-8f34-4887-8e74-39877a6a579b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:54.609865 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d258564-8f34-4887-8e74-39877a6a579b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:54.610335 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d258564-8f34-4887-8e74-39877a6a579b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:54.618427 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b492911e-25c0-44fa-8e35-1d5d9d783a73 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:54.621380 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b492911e-25c0-44fa-8e35-1d5d9d783a73 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:54.625716 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b492911e-25c0-44fa-8e35-1d5d9d783a73 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.183502 Jun 26 03:12:54.626466 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 410/829] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:12:54 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:12:54.759848 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4d258564-8f34-4887-8e74-39877a6a579b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:54.767238 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4d258564-8f34-4887-8e74-39877a6a579b tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1682 microversion: 2.1 time: 0.171754 Jun 26 03:12:54.767795 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 420/830] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:12:54 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:12:55.644413 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f2da3e1a-9e65-4c0e-bc32-286fba7e59e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:55.645028 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f2da3e1a-9e65-4c0e-bc32-286fba7e59e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:55.651609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f2da3e1a-9e65-4c0e-bc32-286fba7e59e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:55.652072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f2da3e1a-9e65-4c0e-bc32-286fba7e59e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:55.652841 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f2da3e1a-9e65-4c0e-bc32-286fba7e59e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:55.653284 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f2da3e1a-9e65-4c0e-bc32-286fba7e59e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:55.783896 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f2da3e1a-9e65-4c0e-bc32-286fba7e59e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:55.784055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-69c4fc7b-6e79-4be3-8164-39bf9de65ead tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:55.784577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-69c4fc7b-6e79-4be3-8164-39bf9de65ead tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:55.791694 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-69c4fc7b-6e79-4be3-8164-39bf9de65ead tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:55.792143 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-69c4fc7b-6e79-4be3-8164-39bf9de65ead tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:55.792908 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-69c4fc7b-6e79-4be3-8164-39bf9de65ead tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:55.793341 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-69c4fc7b-6e79-4be3-8164-39bf9de65ead tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:55.793749 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f2da3e1a-9e65-4c0e-bc32-286fba7e59e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:55.795594 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f2da3e1a-9e65-4c0e-bc32-286fba7e59e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:55.796839 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f2da3e1a-9e65-4c0e-bc32-286fba7e59e8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.156392 Jun 26 03:12:55.797653 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 411/831] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:12:55 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:12:55.934259 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-69c4fc7b-6e79-4be3-8164-39bf9de65ead tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:55.941905 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-69c4fc7b-6e79-4be3-8164-39bf9de65ead tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1682 microversion: 2.1 time: 0.161679 Jun 26 03:12:55.942489 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 421/832] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:12:55 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:12:56.816213 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-14a5c431-f747-456e-8701-2c76434af014 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:56.816735 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-14a5c431-f747-456e-8701-2c76434af014 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:56.823153 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-14a5c431-f747-456e-8701-2c76434af014 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:56.823606 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-14a5c431-f747-456e-8701-2c76434af014 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:56.824374 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-14a5c431-f747-456e-8701-2c76434af014 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:56.824814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-14a5c431-f747-456e-8701-2c76434af014 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:56.962260 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-47e6629f-2b1e-4021-a3c9-8673471d78c6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:56.963796 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-47e6629f-2b1e-4021-a3c9-8673471d78c6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:56.975116 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47e6629f-2b1e-4021-a3c9-8673471d78c6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:56.975897 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47e6629f-2b1e-4021-a3c9-8673471d78c6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:56.978377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47e6629f-2b1e-4021-a3c9-8673471d78c6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:56.979763 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-14a5c431-f747-456e-8701-2c76434af014 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:56.980509 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-47e6629f-2b1e-4021-a3c9-8673471d78c6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:56.996914 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-14a5c431-f747-456e-8701-2c76434af014 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:56.998542 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-14a5c431-f747-456e-8701-2c76434af014 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:56.999722 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-14a5c431-f747-456e-8701-2c76434af014 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.187658 Jun 26 03:12:57.000269 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 412/833] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:12:56 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:12:57.137072 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-47e6629f-2b1e-4021-a3c9-8673471d78c6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:57.144531 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-47e6629f-2b1e-4021-a3c9-8673471d78c6 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1682 microversion: 2.1 time: 0.189585 Jun 26 03:12:57.145096 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 422/834] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:12:56 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:12:57.662843 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-d5679862-a5e5-4827-b789-06bce1ca6d94 req-c9c4fd26-a31e-415e-8883-fdb119222507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b07d92-79ab-4155-972b-7619661bd1d2", "name": "network-vif-deleted", "tag": "fb7d2bf0-48c2-4a67-8477-72edf265c211"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:12:57.672673 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-d5679862-a5e5-4827-b789-06bce1ca6d94 req-c9c4fd26-a31e-415e-8883-fdb119222507 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:57.673134 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-d5679862-a5e5-4827-b789-06bce1ca6d94 req-c9c4fd26-a31e-415e-8883-fdb119222507 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:57.684617 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-d5679862-a5e5-4827-b789-06bce1ca6d94 req-c9c4fd26-a31e-415e-8883-fdb119222507 service nova] Creating event network-vif-deleted:fb7d2bf0-48c2-4a67-8477-72edf265c211 for instance 16b07d92-79ab-4155-972b-7619661bd1d2 on hv-cinder-84684 Jun 26 03:12:57.690435 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-d5679862-a5e5-4827-b789-06bce1ca6d94 req-c9c4fd26-a31e-415e-8883-fdb119222507 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032598 Jun 26 03:12:57.691500 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 413/835] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:12:58.018598 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-bd38b1a2-aff4-48cb-b319-e0c883682a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:58.019167 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-bd38b1a2-aff4-48cb-b319-e0c883682a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:58.025446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd38b1a2-aff4-48cb-b319-e0c883682a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:58.025907 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd38b1a2-aff4-48cb-b319-e0c883682a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:58.026724 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd38b1a2-aff4-48cb-b319-e0c883682a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:58.027165 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd38b1a2-aff4-48cb-b319-e0c883682a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:58.045495 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:12:58.165411 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f15194b9-a2a5-472c-a375-687524d30937 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:58.167567 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f15194b9-a2a5-472c-a375-687524d30937 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:58.176832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bd38b1a2-aff4-48cb-b319-e0c883682a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:58.180475 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f15194b9-a2a5-472c-a375-687524d30937 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:58.181635 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f15194b9-a2a5-472c-a375-687524d30937 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:58.183230 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f15194b9-a2a5-472c-a375-687524d30937 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:58.184357 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f15194b9-a2a5-472c-a375-687524d30937 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:58.193428 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bd38b1a2-aff4-48cb-b319-e0c883682a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:58.196751 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bd38b1a2-aff4-48cb-b319-e0c883682a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:58.198212 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-bd38b1a2-aff4-48cb-b319-e0c883682a27 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1746 microversion: 2.20 time: 0.183506 Jun 26 03:12:58.198845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 423/836] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:12:58 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1746 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:12:58.222377 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f15194b9-a2a5-472c-a375-687524d30937 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:58.222927 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f15194b9-a2a5-472c-a375-687524d30937 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:58.223448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-f15194b9-a2a5-472c-a375-687524d30937 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lazy-loading 'fault' on Instance uuid 16b07d92-79ab-4155-972b-7619661bd1d2 {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:12:58.267781 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f15194b9-a2a5-472c-a375-687524d30937 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:58.275291 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f15194b9-a2a5-472c-a375-687524d30937 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 200 len: 1332 microversion: 2.1 time: 0.116858 Jun 26 03:12:58.275964 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 414/837] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:12:58 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:12:59.217524 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-5d5fca3a-01ab-4213-89a9-bc42c5c5484f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:59.219035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-5d5fca3a-01ab-4213-89a9-bc42c5c5484f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:59.225737 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5d5fca3a-01ab-4213-89a9-bc42c5c5484f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:59.226426 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5d5fca3a-01ab-4213-89a9-bc42c5c5484f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:59.227208 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5d5fca3a-01ab-4213-89a9-bc42c5c5484f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:59.227646 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5d5fca3a-01ab-4213-89a9-bc42c5c5484f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:59.292159 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-64e58bbc-e5a7-4ec9-8af8-d7a1e025400f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:59.292775 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-64e58bbc-e5a7-4ec9-8af8-d7a1e025400f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:12:59.299685 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-64e58bbc-e5a7-4ec9-8af8-d7a1e025400f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:59.300136 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-64e58bbc-e5a7-4ec9-8af8-d7a1e025400f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:59.300917 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-64e58bbc-e5a7-4ec9-8af8-d7a1e025400f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:12:59.301371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-64e58bbc-e5a7-4ec9-8af8-d7a1e025400f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:12:59.315893 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-64e58bbc-e5a7-4ec9-8af8-d7a1e025400f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-64e58bbc-e5a7-4ec9-8af8-d7a1e025400f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 HTTP/1.1 Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:12:59.317729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:12:59.319259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:12:59.319259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:12:59.319259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:12:59.319259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:12:59.319259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:12:59.319259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:12:59.319259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:12:59.319259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:12:59.319259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:12:59.319259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:12:59.319259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:12:59.319259 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '16b07d92-79ab-4155-972b-7619661bd1d2'} Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:12:59.320045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:12:59.321453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:12:59.323958 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-64e58bbc-e5a7-4ec9-8af8-d7a1e025400f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 404 to user: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:12:59.325010 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-64e58bbc-e5a7-4ec9-8af8-d7a1e025400f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 404 len: 111 microversion: 2.1 time: 0.036688 Jun 26 03:12:59.325728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 415/838] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:12:59 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 26 03:12:59.333728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-bb0139da-138f-462f-b43f-f4bb6fa9e023 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '.version_select at 0x7f58275dff70>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:12:59.351524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-bb0139da-138f-462f-b43f-f4bb6fa9e023 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693663904" status: 202 len: 0 microversion: 2.1 time: 0.021299 Jun 26 03:12:59.352162 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 416/839] 10.222.0.13 () {58 vars in 1220 bytes} [Sun Jun 26 03:12:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693663904 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:12:59.370773 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-5d5fca3a-01ab-4213-89a9-bc42c5c5484f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:59.379311 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-5d5fca3a-01ab-4213-89a9-bc42c5c5484f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:59.380813 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-5d5fca3a-01ab-4213-89a9-bc42c5c5484f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:12:59.381968 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-5d5fca3a-01ab-4213-89a9-bc42c5c5484f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1746 microversion: 2.20 time: 0.169062 Jun 26 03:12:59.382918 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 424/840] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:12:59 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:00.021876 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f466768b-8e65-4ffd-80f7-d7240413ba1f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Action: 'create', calling method: .version_select at 0x7f58276d2c10>, body: {"keypair": {"name": "tempest-keypair-390176419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzpMWJyaGk6ENJDVMHUlQQh6AVnH/XWJJpShLUQhKuBWr5yB8qcbSn3ISIWZvmiKDGebczKyG5rbfRn9mVWZbeP9jO8VwlB1o2NFjNQZ4HmogIcIPFuocEGgMipClAhEg=="}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:00.037070 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-f466768b-8e65-4ffd-80f7-d7240413ba1f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for project 1850f9f425294a82add8a09690dc1df0. Resources: {'key_pairs'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:13:00.040862 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-f466768b-8e65-4ffd-80f7-d7240413ba1f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for user 3b7a90ca5e374fc882b644e34e0a3015 and project 1850f9f425294a82add8a09690dc1df0. Resources: {'key_pairs'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:13:00.063021 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f466768b-8e65-4ffd-80f7-d7240413ba1f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045094 Jun 26 03:13:00.063724 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 417/841] 10.222.0.13 () {60 vars in 1158 bytes} [Sun Jun 26 03:13:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:13:00.401553 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e3fe3395-9d83-4a04-be7f-318c9218569f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:00.402736 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e3fe3395-9d83-4a04-be7f-318c9218569f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:00.409202 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e3fe3395-9d83-4a04-be7f-318c9218569f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:00.409664 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e3fe3395-9d83-4a04-be7f-318c9218569f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:00.410532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e3fe3395-9d83-4a04-be7f-318c9218569f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:00.411173 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e3fe3395-9d83-4a04-be7f-318c9218569f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:00.634576 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e3fe3395-9d83-4a04-be7f-318c9218569f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:00.643602 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e3fe3395-9d83-4a04-be7f-318c9218569f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:00.645708 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e3fe3395-9d83-4a04-be7f-318c9218569f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:00.647088 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e3fe3395-9d83-4a04-be7f-318c9218569f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1746 microversion: 2.20 time: 0.250583 Jun 26 03:13:00.647759 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 425/842] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:00 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1746 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:01.084456 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-e8eecfb9-1b99-46ad-b057-bddbb7e56131 req-ea255430-5304-45a4-952d-cb5d0648e216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee71e3f2-a415-4000-97d4-290a4675ee4e", "name": "network-vif-plugged", "status": "completed", "tag": "7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:01.096207 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-e8eecfb9-1b99-46ad-b057-bddbb7e56131 req-ea255430-5304-45a4-952d-cb5d0648e216 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:01.099244 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-e8eecfb9-1b99-46ad-b057-bddbb7e56131 req-ea255430-5304-45a4-952d-cb5d0648e216 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:01.113902 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-e8eecfb9-1b99-46ad-b057-bddbb7e56131 req-ea255430-5304-45a4-952d-cb5d0648e216 service nova] Creating event network-vif-plugged:7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6 for instance ee71e3f2-a415-4000-97d4-290a4675ee4e on hv-cinder-84684 Jun 26 03:13:01.118791 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-e8eecfb9-1b99-46ad-b057-bddbb7e56131 req-ea255430-5304-45a4-952d-cb5d0648e216 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038818 Jun 26 03:13:01.120183 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 418/843] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:13:01.667105 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b85fb83b-21ff-4ede-9386-a2bc74ece147 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:01.667711 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b85fb83b-21ff-4ede-9386-a2bc74ece147 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:01.674350 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b85fb83b-21ff-4ede-9386-a2bc74ece147 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:01.674801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b85fb83b-21ff-4ede-9386-a2bc74ece147 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:01.675567 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b85fb83b-21ff-4ede-9386-a2bc74ece147 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:01.676000 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b85fb83b-21ff-4ede-9386-a2bc74ece147 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:01.690957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2014823652", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02cd0f74-99cd-4eb9-aeb7-aae2b7255a50"}], "security_groups": [{"name": "tempest-securitygroup--1354065305"}], "key_name": "tempest-keypair-390176419", "user_data": "}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:01.831168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.network.neutron [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] validate_networks() for [('02cd0f74-99cd-4eb9-aeb7-aae2b7255a50', None, None, None, None, None)] {{(pid=117782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:13:01.836392 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b85fb83b-21ff-4ede-9386-a2bc74ece147 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:01.845567 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b85fb83b-21ff-4ede-9386-a2bc74ece147 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:01.847102 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b85fb83b-21ff-4ede-9386-a2bc74ece147 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:01.848722 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b85fb83b-21ff-4ede-9386-a2bc74ece147 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1746 microversion: 2.20 time: 0.186036 Jun 26 03:13:01.849470 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 426/844] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:01 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1746 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:02.191927 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Flavor limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:13:02.192424 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Image limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:13:02.192817 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Flavor pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:13:02.193229 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Image pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:13:02.193643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:13:02.203690 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:02.204144 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:02.204951 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:02.205393 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:02.221771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for project 1850f9f425294a82add8a09690dc1df0. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:13:02.225735 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Getting quotas for user 3b7a90ca5e374fc882b644e34e0a3015 and project 1850f9f425294a82add8a09690dc1df0. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:13:02.236614 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Going to run 1 instances... {{(pid=117782) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:13:02.238973 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:13:02.285529 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2080f69c-19aa-4ef9-a93d-42dd2841cd84 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.599019 Jun 26 03:13:02.286156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 419/845] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:13:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 26 03:13:02.296216 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a84e8a01-f2eb-45cf-8b5b-c6a7ae928eb8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:02.296833 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a84e8a01-f2eb-45cf-8b5b-c6a7ae928eb8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:02.349094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a84e8a01-f2eb-45cf-8b5b-c6a7ae928eb8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:02.355901 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a84e8a01-f2eb-45cf-8b5b-c6a7ae928eb8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1241 microversion: 2.1 time: 0.063544 Jun 26 03:13:02.356468 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 427/846] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:02 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:02.867214 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-03b62a5f-f84b-4334-94ae-db801be08baf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:02.867825 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-03b62a5f-f84b-4334-94ae-db801be08baf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:02.875598 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-03b62a5f-f84b-4334-94ae-db801be08baf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:02.876053 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-03b62a5f-f84b-4334-94ae-db801be08baf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:02.876829 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-03b62a5f-f84b-4334-94ae-db801be08baf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:02.877269 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-03b62a5f-f84b-4334-94ae-db801be08baf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:03.009248 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-03b62a5f-f84b-4334-94ae-db801be08baf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:03.017156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-03b62a5f-f84b-4334-94ae-db801be08baf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:03.018705 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-03b62a5f-f84b-4334-94ae-db801be08baf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:03.019861 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-03b62a5f-f84b-4334-94ae-db801be08baf tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1746 microversion: 2.20 time: 0.156660 Jun 26 03:13:03.020416 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 420/847] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:02 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:03.162131 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1877557595", "imageRef": "4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef", "flavorRef": "452"}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:03.213930 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] validate_networks() for None {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:13:03.373412 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7a887ca4-23f6-45f2-9fab-1ab96004e16f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:03.374036 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7a887ca4-23f6-45f2-9fab-1ab96004e16f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:03.382280 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7a887ca4-23f6-45f2-9fab-1ab96004e16f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:03.382937 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7a887ca4-23f6-45f2-9fab-1ab96004e16f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:03.384788 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7a887ca4-23f6-45f2-9fab-1ab96004e16f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:03.385901 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7a887ca4-23f6-45f2-9fab-1ab96004e16f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:03.484186 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7a887ca4-23f6-45f2-9fab-1ab96004e16f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:03.491847 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-7a887ca4-23f6-45f2-9fab-1ab96004e16f tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1311 microversion: 2.1 time: 0.122837 Jun 26 03:13:03.492420 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 421/848] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:03 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1311 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:13:03.533170 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:13:03.533588 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:13:03.534108 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:13:03.534521 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:13:03.534928 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:13:03.543502 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:03.543948 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:03.544728 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:03.545167 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:03.561569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Getting quotas for project fbf9d500fd3a41cdb218a5f3377c68ea. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:13:03.565431 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Getting quotas for user 052955a0039745a9b93cb81164501501 and project fbf9d500fd3a41cdb218a5f3377c68ea. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:13:03.581348 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:13:03.583727 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4aaeb8ae-07cb-44eb-8ef9-e2ea3e01e8ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:13:03.630894 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9588a9d9-9d0d-4747-8063-65293aa0aa22 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.472478 Jun 26 03:13:03.631724 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 428/849] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:13:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:13:03.641849 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8bad8e35-39a8-4c2c-b4e8-b633b0084e50 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:03.642495 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8bad8e35-39a8-4c2c-b4e8-b633b0084e50 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:03.696414 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8bad8e35-39a8-4c2c-b4e8-b633b0084e50 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:03.706113 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8bad8e35-39a8-4c2c-b4e8-b633b0084e50 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1215 microversion: 2.1 time: 0.067640 Jun 26 03:13:03.706726 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 422/850] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:03 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:13:04.038636 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d1d33aab-30f4-4332-b19d-61f21d29416b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:04.039258 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d1d33aab-30f4-4332-b19d-61f21d29416b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:04.046815 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d1d33aab-30f4-4332-b19d-61f21d29416b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:04.047275 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d1d33aab-30f4-4332-b19d-61f21d29416b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:04.048067 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d1d33aab-30f4-4332-b19d-61f21d29416b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:04.048512 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d1d33aab-30f4-4332-b19d-61f21d29416b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:04.204409 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d1d33aab-30f4-4332-b19d-61f21d29416b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:04.213866 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d1d33aab-30f4-4332-b19d-61f21d29416b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:04.215423 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d1d33aab-30f4-4332-b19d-61f21d29416b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:04.217107 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d1d33aab-30f4-4332-b19d-61f21d29416b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1746 microversion: 2.20 time: 0.182445 Jun 26 03:13:04.218117 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 429/851] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:04 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1746 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:04.509973 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-33757769-31fb-4a06-b2a3-4f8c39cb6d0c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:04.510778 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-33757769-31fb-4a06-b2a3-4f8c39cb6d0c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:04.517617 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-33757769-31fb-4a06-b2a3-4f8c39cb6d0c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:04.518197 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-33757769-31fb-4a06-b2a3-4f8c39cb6d0c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:04.519108 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-33757769-31fb-4a06-b2a3-4f8c39cb6d0c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:04.519553 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-33757769-31fb-4a06-b2a3-4f8c39cb6d0c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:04.687571 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-33757769-31fb-4a06-b2a3-4f8c39cb6d0c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:04.691344 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:04.695847 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-33757769-31fb-4a06-b2a3-4f8c39cb6d0c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1367 microversion: 2.1 time: 0.190235 Jun 26 03:13:04.696421 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 423/852] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:04 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:04.722522 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b782f69d-c84d-4569-8256-d88c9f28f966 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:04.723157 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b782f69d-c84d-4569-8256-d88c9f28f966 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:04.730398 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b782f69d-c84d-4569-8256-d88c9f28f966 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:04.731101 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b782f69d-c84d-4569-8256-d88c9f28f966 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:04.731880 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b782f69d-c84d-4569-8256-d88c9f28f966 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:04.732311 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b782f69d-c84d-4569-8256-d88c9f28f966 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:04.802606 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-bae3daf8-d1c1-479e-8cbb-b786f30bb1e2 req-223a9dfb-2e41-47b1-83dc-7e930b90128a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c44a3421-d825-4b89-9c4e-8aa8112595d2", "tag": "ab7ff115-6093-4813-966f-56337f1c2db6"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:04.809140 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b782f69d-c84d-4569-8256-d88c9f28f966 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:04.813708 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-bae3daf8-d1c1-479e-8cbb-b786f30bb1e2 req-223a9dfb-2e41-47b1-83dc-7e930b90128a service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:04.814439 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-bae3daf8-d1c1-479e-8cbb-b786f30bb1e2 req-223a9dfb-2e41-47b1-83dc-7e930b90128a service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:04.818005 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b782f69d-c84d-4569-8256-d88c9f28f966 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1267 microversion: 2.1 time: 0.099173 Jun 26 03:13:04.819129 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 430/853] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:04 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:04.837158 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-bae3daf8-d1c1-479e-8cbb-b786f30bb1e2 req-223a9dfb-2e41-47b1-83dc-7e930b90128a service nova] Creating event network-changed:ab7ff115-6093-4813-966f-56337f1c2db6 for instance c44a3421-d825-4b89-9c4e-8aa8112595d2 on hv-cinder-84684 Jun 26 03:13:04.842923 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-bae3daf8-d1c1-479e-8cbb-b786f30bb1e2 req-223a9dfb-2e41-47b1-83dc-7e930b90128a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044104 Jun 26 03:13:04.843532 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 424/854] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:13:05.235646 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-86f1dc15-a7d3-47b2-a47a-102e99d524c0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:05.236274 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-86f1dc15-a7d3-47b2-a47a-102e99d524c0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:05.242897 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86f1dc15-a7d3-47b2-a47a-102e99d524c0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:05.243266 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86f1dc15-a7d3-47b2-a47a-102e99d524c0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:05.244041 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86f1dc15-a7d3-47b2-a47a-102e99d524c0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:05.245149 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86f1dc15-a7d3-47b2-a47a-102e99d524c0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:05.517223 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-86f1dc15-a7d3-47b2-a47a-102e99d524c0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:05.529550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-86f1dc15-a7d3-47b2-a47a-102e99d524c0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:05.531085 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-86f1dc15-a7d3-47b2-a47a-102e99d524c0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:05.532588 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-86f1dc15-a7d3-47b2-a47a-102e99d524c0 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1741 microversion: 2.20 time: 0.301379 Jun 26 03:13:05.533163 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 431/855] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:05 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:05.717035 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-202e8aba-9667-400e-8d2d-a8598454f9a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:05.717750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-202e8aba-9667-400e-8d2d-a8598454f9a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:05.725805 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-202e8aba-9667-400e-8d2d-a8598454f9a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:05.734511 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-202e8aba-9667-400e-8d2d-a8598454f9a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:05.735441 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-202e8aba-9667-400e-8d2d-a8598454f9a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:05.735901 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-202e8aba-9667-400e-8d2d-a8598454f9a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:05.835199 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-91f1abaf-a67d-407b-b756-da46395a9a19 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:05.836074 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-91f1abaf-a67d-407b-b756-da46395a9a19 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:05.843979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-91f1abaf-a67d-407b-b756-da46395a9a19 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:05.844442 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-91f1abaf-a67d-407b-b756-da46395a9a19 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:05.845228 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-91f1abaf-a67d-407b-b756-da46395a9a19 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:05.845682 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-91f1abaf-a67d-407b-b756-da46395a9a19 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:06.034278 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-91f1abaf-a67d-407b-b756-da46395a9a19 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:06.034669 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-202e8aba-9667-400e-8d2d-a8598454f9a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:06.067686 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-91f1abaf-a67d-407b-b756-da46395a9a19 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1273 microversion: 2.1 time: 0.236196 Jun 26 03:13:06.076182 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 432/856] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:05 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:06.081527 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-202e8aba-9667-400e-8d2d-a8598454f9a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1367 microversion: 2.1 time: 0.368227 Jun 26 03:13:06.082474 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 425/857] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:05 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:06.551049 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-601462db-1cd5-4f57-b96e-f565ea29feab tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:06.552338 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-601462db-1cd5-4f57-b96e-f565ea29feab tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:06.560088 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-601462db-1cd5-4f57-b96e-f565ea29feab tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:06.560788 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-601462db-1cd5-4f57-b96e-f565ea29feab tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:06.561757 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-601462db-1cd5-4f57-b96e-f565ea29feab tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:06.562387 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-601462db-1cd5-4f57-b96e-f565ea29feab tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:06.705628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-601462db-1cd5-4f57-b96e-f565ea29feab tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:06.714617 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-601462db-1cd5-4f57-b96e-f565ea29feab tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:06.716117 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-601462db-1cd5-4f57-b96e-f565ea29feab tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:06.717307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-601462db-1cd5-4f57-b96e-f565ea29feab tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1741 microversion: 2.20 time: 0.170096 Jun 26 03:13:06.717836 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 433/858] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:06 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:07.090996 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5cd6c657-3948-4a39-9cc3-85b84304ed3a tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:07.091608 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5cd6c657-3948-4a39-9cc3-85b84304ed3a tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:07.100995 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d9fc8a36-72a4-4dd0-bb8f-b3a6d568cd54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:07.101684 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5cd6c657-3948-4a39-9cc3-85b84304ed3a tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:07.102170 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5cd6c657-3948-4a39-9cc3-85b84304ed3a tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:07.102505 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d9fc8a36-72a4-4dd0-bb8f-b3a6d568cd54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:07.103036 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5cd6c657-3948-4a39-9cc3-85b84304ed3a tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:07.103796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5cd6c657-3948-4a39-9cc3-85b84304ed3a tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:07.109739 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d9fc8a36-72a4-4dd0-bb8f-b3a6d568cd54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:07.110493 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d9fc8a36-72a4-4dd0-bb8f-b3a6d568cd54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:07.111491 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d9fc8a36-72a4-4dd0-bb8f-b3a6d568cd54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:07.112168 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d9fc8a36-72a4-4dd0-bb8f-b3a6d568cd54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:07.335863 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d9fc8a36-72a4-4dd0-bb8f-b3a6d568cd54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:07.343570 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5cd6c657-3948-4a39-9cc3-85b84304ed3a tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:07.347064 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d9fc8a36-72a4-4dd0-bb8f-b3a6d568cd54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1367 microversion: 2.1 time: 0.251864 Jun 26 03:13:07.352809 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5cd6c657-3948-4a39-9cc3-85b84304ed3a tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1315 microversion: 2.1 time: 0.266186 Jun 26 03:13:07.357981 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 434/859] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:07 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:13:07.360556 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 426/860] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:07 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:07.735755 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-470f70cf-2052-4c00-a4af-ccdbd4f9b0db tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:07.736470 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-470f70cf-2052-4c00-a4af-ccdbd4f9b0db tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:07.743557 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-470f70cf-2052-4c00-a4af-ccdbd4f9b0db tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:07.744269 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-470f70cf-2052-4c00-a4af-ccdbd4f9b0db tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:07.745405 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-470f70cf-2052-4c00-a4af-ccdbd4f9b0db tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:07.745850 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-470f70cf-2052-4c00-a4af-ccdbd4f9b0db tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:07.894984 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-470f70cf-2052-4c00-a4af-ccdbd4f9b0db tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:07.903807 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-470f70cf-2052-4c00-a4af-ccdbd4f9b0db tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:07.905390 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-470f70cf-2052-4c00-a4af-ccdbd4f9b0db tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:07.906654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-470f70cf-2052-4c00-a4af-ccdbd4f9b0db tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1741 microversion: 2.20 time: 0.174914 Jun 26 03:13:07.907435 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 435/861] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:07 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:08.366492 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c4c75bfc-6fb1-4c65-9284-c786d4f96956 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:08.367858 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c4c75bfc-6fb1-4c65-9284-c786d4f96956 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:08.372488 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-910a32a0-01d8-4027-8ead-2dc4a05dda51 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:08.373406 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-910a32a0-01d8-4027-8ead-2dc4a05dda51 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:08.375643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c4c75bfc-6fb1-4c65-9284-c786d4f96956 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:08.376176 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c4c75bfc-6fb1-4c65-9284-c786d4f96956 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:08.377036 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c4c75bfc-6fb1-4c65-9284-c786d4f96956 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:08.377535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c4c75bfc-6fb1-4c65-9284-c786d4f96956 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:08.380274 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-910a32a0-01d8-4027-8ead-2dc4a05dda51 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:08.380669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-910a32a0-01d8-4027-8ead-2dc4a05dda51 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:08.381423 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-910a32a0-01d8-4027-8ead-2dc4a05dda51 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:08.383282 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-910a32a0-01d8-4027-8ead-2dc4a05dda51 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:08.535450 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-910a32a0-01d8-4027-8ead-2dc4a05dda51 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:08.544646 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-910a32a0-01d8-4027-8ead-2dc4a05dda51 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1315 microversion: 2.1 time: 0.176744 Jun 26 03:13:08.545269 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 436/862] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:08 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:13:08.685620 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c4c75bfc-6fb1-4c65-9284-c786d4f96956 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:08.693371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c4c75bfc-6fb1-4c65-9284-c786d4f96956 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1367 microversion: 2.1 time: 0.332557 Jun 26 03:13:08.694343 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 427/863] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:08 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:08.925673 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-baaf5283-ffe9-462d-939d-518fb1523254 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:08.926775 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-baaf5283-ffe9-462d-939d-518fb1523254 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:08.936719 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-baaf5283-ffe9-462d-939d-518fb1523254 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:08.944085 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-baaf5283-ffe9-462d-939d-518fb1523254 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:08.946116 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-baaf5283-ffe9-462d-939d-518fb1523254 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:08.946747 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-baaf5283-ffe9-462d-939d-518fb1523254 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:09.223190 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-baaf5283-ffe9-462d-939d-518fb1523254 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:09.249808 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-baaf5283-ffe9-462d-939d-518fb1523254 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:09.253603 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-baaf5283-ffe9-462d-939d-518fb1523254 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:09.256232 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-baaf5283-ffe9-462d-939d-518fb1523254 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1741 microversion: 2.20 time: 0.334843 Jun 26 03:13:09.258926 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 437/864] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:08 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1741 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:09.508627 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-fc38628c-14f0-4d19-a1ad-bf6959eea761 req-74d3be15-c791-4ec3-b6a9-0cdf5486f96d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd", "tag": "619dd00f-2ea8-4823-b3cf-9aefd955dab8"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:09.525488 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-fc38628c-14f0-4d19-a1ad-bf6959eea761 req-74d3be15-c791-4ec3-b6a9-0cdf5486f96d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:09.526931 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-fc38628c-14f0-4d19-a1ad-bf6959eea761 req-74d3be15-c791-4ec3-b6a9-0cdf5486f96d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:09.542222 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-fc38628c-14f0-4d19-a1ad-bf6959eea761 req-74d3be15-c791-4ec3-b6a9-0cdf5486f96d service nova] Creating event network-changed:619dd00f-2ea8-4823-b3cf-9aefd955dab8 for instance 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd on hv-cinder-84684 Jun 26 03:13:09.548494 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-fc38628c-14f0-4d19-a1ad-bf6959eea761 req-74d3be15-c791-4ec3-b6a9-0cdf5486f96d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044409 Jun 26 03:13:09.549663 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 428/865] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:13:09.564832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4817560d-a17a-467f-a35d-3a9b2caf9ae6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:09.565655 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4817560d-a17a-467f-a35d-3a9b2caf9ae6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:09.573566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4817560d-a17a-467f-a35d-3a9b2caf9ae6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:09.574352 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4817560d-a17a-467f-a35d-3a9b2caf9ae6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:09.577507 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4817560d-a17a-467f-a35d-3a9b2caf9ae6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:09.581806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4817560d-a17a-467f-a35d-3a9b2caf9ae6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:09.713988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-013d39a8-0fed-4481-b714-7092403c9ed8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:09.714737 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-013d39a8-0fed-4481-b714-7092403c9ed8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:09.731739 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-013d39a8-0fed-4481-b714-7092403c9ed8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:09.732194 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-013d39a8-0fed-4481-b714-7092403c9ed8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:09.732993 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-013d39a8-0fed-4481-b714-7092403c9ed8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:09.733491 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-013d39a8-0fed-4481-b714-7092403c9ed8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:09.849907 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4817560d-a17a-467f-a35d-3a9b2caf9ae6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:09.862544 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4817560d-a17a-467f-a35d-3a9b2caf9ae6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1315 microversion: 2.1 time: 0.302486 Jun 26 03:13:09.865550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 438/866] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:09 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:09.992193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-013d39a8-0fed-4481-b714-7092403c9ed8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:10.000470 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-013d39a8-0fed-4481-b714-7092403c9ed8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1367 microversion: 2.1 time: 0.292626 Jun 26 03:13:10.001267 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 429/867] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:09 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:13:10.276586 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c2b40b58-d351-44bc-ad7f-5b2a1e0edd6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:10.277143 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c2b40b58-d351-44bc-ad7f-5b2a1e0edd6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:10.284085 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c2b40b58-d351-44bc-ad7f-5b2a1e0edd6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:10.284546 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c2b40b58-d351-44bc-ad7f-5b2a1e0edd6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:10.285330 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c2b40b58-d351-44bc-ad7f-5b2a1e0edd6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:10.285771 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c2b40b58-d351-44bc-ad7f-5b2a1e0edd6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:10.429728 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c2b40b58-d351-44bc-ad7f-5b2a1e0edd6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:10.440061 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c2b40b58-d351-44bc-ad7f-5b2a1e0edd6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:10.442627 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c2b40b58-d351-44bc-ad7f-5b2a1e0edd6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:10.443791 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c2b40b58-d351-44bc-ad7f-5b2a1e0edd6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1741 microversion: 2.20 time: 0.171312 Jun 26 03:13:10.444514 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 439/868] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:10 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:10.881538 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8569b40d-1cb8-4106-a8c1-3e6fef8858b8 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:10.882178 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8569b40d-1cb8-4106-a8c1-3e6fef8858b8 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:10.888801 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8569b40d-1cb8-4106-a8c1-3e6fef8858b8 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:10.889258 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8569b40d-1cb8-4106-a8c1-3e6fef8858b8 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:10.890031 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8569b40d-1cb8-4106-a8c1-3e6fef8858b8 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:10.890666 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8569b40d-1cb8-4106-a8c1-3e6fef8858b8 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:11.034303 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fc0bc931-0692-45bf-bc43-d964de6621a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:11.035090 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fc0bc931-0692-45bf-bc43-d964de6621a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:11.043474 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8569b40d-1cb8-4106-a8c1-3e6fef8858b8 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:11.048855 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fc0bc931-0692-45bf-bc43-d964de6621a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:11.049768 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fc0bc931-0692-45bf-bc43-d964de6621a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:11.050703 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fc0bc931-0692-45bf-bc43-d964de6621a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:11.051533 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fc0bc931-0692-45bf-bc43-d964de6621a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:11.055471 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8569b40d-1cb8-4106-a8c1-3e6fef8858b8 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1315 microversion: 2.1 time: 0.177721 Jun 26 03:13:11.056066 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 430/869] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:10 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:11.193047 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-053d6199-01d8-475a-91b3-957e873997a4 req-a92b7dad-8824-496e-a24e-1242bd6e153a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44a3421-d825-4b89-9c4e-8aa8112595d2", "name": "network-vif-plugged", "status": "completed", "tag": "ab7ff115-6093-4813-966f-56337f1c2db6"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:11.196053 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fc0bc931-0692-45bf-bc43-d964de6621a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:11.203335 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-053d6199-01d8-475a-91b3-957e873997a4 req-a92b7dad-8824-496e-a24e-1242bd6e153a service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:11.204608 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-053d6199-01d8-475a-91b3-957e873997a4 req-a92b7dad-8824-496e-a24e-1242bd6e153a service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:11.207233 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fc0bc931-0692-45bf-bc43-d964de6621a4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1367 microversion: 2.1 time: 0.192903 Jun 26 03:13:11.210144 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 440/870] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:11 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:13:11.229248 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-053d6199-01d8-475a-91b3-957e873997a4 req-a92b7dad-8824-496e-a24e-1242bd6e153a service nova] Creating event network-vif-plugged:ab7ff115-6093-4813-966f-56337f1c2db6 for instance c44a3421-d825-4b89-9c4e-8aa8112595d2 on hv-cinder-84684 Jun 26 03:13:11.236657 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-053d6199-01d8-475a-91b3-957e873997a4 req-a92b7dad-8824-496e-a24e-1242bd6e153a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047756 Jun 26 03:13:11.237908 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 431/871] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:13:11.463083 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-00557658-5e7f-432d-8a91-f1f113002810 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:11.463898 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-00557658-5e7f-432d-8a91-f1f113002810 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:11.471300 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00557658-5e7f-432d-8a91-f1f113002810 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:11.471770 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00557658-5e7f-432d-8a91-f1f113002810 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:11.472571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00557658-5e7f-432d-8a91-f1f113002810 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:11.473017 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00557658-5e7f-432d-8a91-f1f113002810 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:11.620801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-00557658-5e7f-432d-8a91-f1f113002810 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:11.624523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=100 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:11.631951 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-00557658-5e7f-432d-8a91-f1f113002810 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:11.633480 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-00557658-5e7f-432d-8a91-f1f113002810 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:11.635156 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-00557658-5e7f-432d-8a91-f1f113002810 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1741 microversion: 2.20 time: 0.176013 Jun 26 03:13:11.635785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 441/872] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:11 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:12.073667 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d9fd65a0-26a5-4fd8-82ec-2e781d57f585 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:12.074493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d9fd65a0-26a5-4fd8-82ec-2e781d57f585 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:12.080715 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d9fd65a0-26a5-4fd8-82ec-2e781d57f585 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:12.081418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d9fd65a0-26a5-4fd8-82ec-2e781d57f585 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:12.082432 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d9fd65a0-26a5-4fd8-82ec-2e781d57f585 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:12.083036 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d9fd65a0-26a5-4fd8-82ec-2e781d57f585 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:12.213663 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=2 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:12.225674 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-833c41ad-f4de-4873-ac40-0efe5225f510 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:12.226826 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-833c41ad-f4de-4873-ac40-0efe5225f510 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:12.233225 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d9fd65a0-26a5-4fd8-82ec-2e781d57f585 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:12.234590 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-833c41ad-f4de-4873-ac40-0efe5225f510 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:12.235469 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-833c41ad-f4de-4873-ac40-0efe5225f510 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:12.236509 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-833c41ad-f4de-4873-ac40-0efe5225f510 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:12.237270 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-833c41ad-f4de-4873-ac40-0efe5225f510 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:12.244555 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d9fd65a0-26a5-4fd8-82ec-2e781d57f585 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1315 microversion: 2.1 time: 0.175422 Jun 26 03:13:12.245140 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 432/873] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:12 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:12.377095 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-833c41ad-f4de-4873-ac40-0efe5225f510 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:12.385877 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-833c41ad-f4de-4873-ac40-0efe5225f510 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1367 microversion: 2.1 time: 0.164629 Jun 26 03:13:12.394090 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 442/874] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:12 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:13:12.652934 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-461d5697-c67f-47c6-8363-1127a8fb4fd8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:12.653543 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-461d5697-c67f-47c6-8363-1127a8fb4fd8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:12.659801 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-461d5697-c67f-47c6-8363-1127a8fb4fd8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:12.660262 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-461d5697-c67f-47c6-8363-1127a8fb4fd8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:12.661038 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-461d5697-c67f-47c6-8363-1127a8fb4fd8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:12.661482 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-461d5697-c67f-47c6-8363-1127a8fb4fd8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:13.164590 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-461d5697-c67f-47c6-8363-1127a8fb4fd8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:13.179117 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-461d5697-c67f-47c6-8363-1127a8fb4fd8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:13.182114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-461d5697-c67f-47c6-8363-1127a8fb4fd8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:13.184778 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-461d5697-c67f-47c6-8363-1127a8fb4fd8 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1741 microversion: 2.20 time: 0.534748 Jun 26 03:13:13.190405 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 433/875] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:12 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1741 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:13.261939 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-53a8c07d-f51c-49d3-8501-46b7a6800716 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:13.262601 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-53a8c07d-f51c-49d3-8501-46b7a6800716 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:13.265054 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:13.274632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-53a8c07d-f51c-49d3-8501-46b7a6800716 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:13.275085 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-53a8c07d-f51c-49d3-8501-46b7a6800716 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:13.275937 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-53a8c07d-f51c-49d3-8501-46b7a6800716 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:13.276383 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-53a8c07d-f51c-49d3-8501-46b7a6800716 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:13.409388 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1bbeb1d2-77af-469d-ab48-9a7001c30abe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:13.410609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1bbeb1d2-77af-469d-ab48-9a7001c30abe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:13.413027 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:13.418792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1bbeb1d2-77af-469d-ab48-9a7001c30abe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:13.419637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1bbeb1d2-77af-469d-ab48-9a7001c30abe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:13.420699 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1bbeb1d2-77af-469d-ab48-9a7001c30abe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:13.421366 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1bbeb1d2-77af-469d-ab48-9a7001c30abe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:13.473911 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-53a8c07d-f51c-49d3-8501-46b7a6800716 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:13.483573 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-53a8c07d-f51c-49d3-8501-46b7a6800716 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1315 microversion: 2.1 time: 0.226094 Jun 26 03:13:13.484981 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 443/876] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:13 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:13.626272 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1bbeb1d2-77af-469d-ab48-9a7001c30abe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:13.636262 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1bbeb1d2-77af-469d-ab48-9a7001c30abe tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1367 microversion: 2.1 time: 0.236728 Jun 26 03:13:13.645624 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 434/877] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:13 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:14.203981 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-803b0a99-1443-460a-990a-853dbb813c02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:14.205092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-803b0a99-1443-460a-990a-853dbb813c02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:14.208228 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=2 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:14.209143 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=8 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:14.214616 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-803b0a99-1443-460a-990a-853dbb813c02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:14.215336 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-803b0a99-1443-460a-990a-853dbb813c02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:14.216420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-803b0a99-1443-460a-990a-853dbb813c02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:14.217120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-803b0a99-1443-460a-990a-853dbb813c02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:14.447215 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-803b0a99-1443-460a-990a-853dbb813c02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:14.458910 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-803b0a99-1443-460a-990a-853dbb813c02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:14.460323 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-803b0a99-1443-460a-990a-853dbb813c02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:14.461492 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-803b0a99-1443-460a-990a-853dbb813c02 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1741 microversion: 2.20 time: 0.262090 Jun 26 03:13:14.462081 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 444/878] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:14 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1741 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:14.500903 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7319f644-1be1-4dc2-bba6-a0b523b4422f tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:14.502327 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7319f644-1be1-4dc2-bba6-a0b523b4422f tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:14.505803 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=12 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:14.511878 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7319f644-1be1-4dc2-bba6-a0b523b4422f tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:14.512445 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7319f644-1be1-4dc2-bba6-a0b523b4422f tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:14.513528 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7319f644-1be1-4dc2-bba6-a0b523b4422f tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:14.514258 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7319f644-1be1-4dc2-bba6-a0b523b4422f tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:14.656748 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-31891ff6-e903-4c52-8a3f-5bd8c4d72639 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:14.657845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-31891ff6-e903-4c52-8a3f-5bd8c4d72639 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:14.669044 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-31891ff6-e903-4c52-8a3f-5bd8c4d72639 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:14.669690 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-31891ff6-e903-4c52-8a3f-5bd8c4d72639 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:14.671317 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-31891ff6-e903-4c52-8a3f-5bd8c4d72639 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:14.671782 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-31891ff6-e903-4c52-8a3f-5bd8c4d72639 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:14.674331 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7319f644-1be1-4dc2-bba6-a0b523b4422f tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:14.685834 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-7319f644-1be1-4dc2-bba6-a0b523b4422f tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1315 microversion: 2.1 time: 0.188359 Jun 26 03:13:14.687271 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 435/879] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:14 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:14.844466 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-31891ff6-e903-4c52-8a3f-5bd8c4d72639 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:14.860125 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-31891ff6-e903-4c52-8a3f-5bd8c4d72639 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1557 microversion: 2.1 time: 0.210777 Jun 26 03:13:14.861271 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 445/880] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:14 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1557 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:14.880190 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-76c0c704-2982-460d-a414-5aecd772de2e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:14.881090 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-76c0c704-2982-460d-a414-5aecd772de2e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:14.888486 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-76c0c704-2982-460d-a414-5aecd772de2e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:14.889216 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-76c0c704-2982-460d-a414-5aecd772de2e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:14.890183 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-76c0c704-2982-460d-a414-5aecd772de2e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:14.890821 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-76c0c704-2982-460d-a414-5aecd772de2e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:14.976880 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-76c0c704-2982-460d-a414-5aecd772de2e tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101277 Jun 26 03:13:14.978682 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 436/881] 10.222.0.13 () {58 vars in 1274 bytes} [Sun Jun 26 03:13:14 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:13:15.189157 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-c79a7a74-7217-4c34-866e-0d8c1d952242 req-3cd86713-85fd-4916-8a2d-0b33a9cfa90d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd", "name": "network-vif-plugged", "status": "completed", "tag": "619dd00f-2ea8-4823-b3cf-9aefd955dab8"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:15.206749 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-c79a7a74-7217-4c34-866e-0d8c1d952242 req-3cd86713-85fd-4916-8a2d-0b33a9cfa90d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:15.208633 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-c79a7a74-7217-4c34-866e-0d8c1d952242 req-3cd86713-85fd-4916-8a2d-0b33a9cfa90d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:15.230643 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-c79a7a74-7217-4c34-866e-0d8c1d952242 req-3cd86713-85fd-4916-8a2d-0b33a9cfa90d service nova] Creating event network-vif-plugged:619dd00f-2ea8-4823-b3cf-9aefd955dab8 for instance 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd on hv-cinder-84684 Jun 26 03:13:15.241306 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-c79a7a74-7217-4c34-866e-0d8c1d952242 req-3cd86713-85fd-4916-8a2d-0b33a9cfa90d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056270 Jun 26 03:13:15.242660 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 446/882] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:13:15.482441 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4d1ae6c9-0889-4446-a21b-137b8dc6c192 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:15.483411 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4d1ae6c9-0889-4446-a21b-137b8dc6c192 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:15.491463 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4d1ae6c9-0889-4446-a21b-137b8dc6c192 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:15.492037 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4d1ae6c9-0889-4446-a21b-137b8dc6c192 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:15.493113 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4d1ae6c9-0889-4446-a21b-137b8dc6c192 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:15.493608 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4d1ae6c9-0889-4446-a21b-137b8dc6c192 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:15.704107 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ddccac27-3b1f-46ca-aeeb-27a3629df756 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:15.704972 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ddccac27-3b1f-46ca-aeeb-27a3629df756 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:15.712449 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ddccac27-3b1f-46ca-aeeb-27a3629df756 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:15.713431 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ddccac27-3b1f-46ca-aeeb-27a3629df756 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:15.714250 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ddccac27-3b1f-46ca-aeeb-27a3629df756 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:15.714693 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ddccac27-3b1f-46ca-aeeb-27a3629df756 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:15.773214 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4d1ae6c9-0889-4446-a21b-137b8dc6c192 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:15.781612 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4d1ae6c9-0889-4446-a21b-137b8dc6c192 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:15.783186 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4d1ae6c9-0889-4446-a21b-137b8dc6c192 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:15.784353 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4d1ae6c9-0889-4446-a21b-137b8dc6c192 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1741 microversion: 2.20 time: 0.306944 Jun 26 03:13:15.784911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 437/883] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:15 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1741 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:15.929948 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ddccac27-3b1f-46ca-aeeb-27a3629df756 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:15.937353 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ddccac27-3b1f-46ca-aeeb-27a3629df756 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1315 microversion: 2.1 time: 0.237919 Jun 26 03:13:15.938121 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 447/884] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:15 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:16.183981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-85c180e0-34ed-49e5-84f5-cc0742bb0fdf req-bc4994bc-d824-470f-a104-d78f75c1a45e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c44a3421-d825-4b89-9c4e-8aa8112595d2", "tag": "ab7ff115-6093-4813-966f-56337f1c2db6"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:16.192420 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-85c180e0-34ed-49e5-84f5-cc0742bb0fdf req-bc4994bc-d824-470f-a104-d78f75c1a45e service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:16.192951 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-85c180e0-34ed-49e5-84f5-cc0742bb0fdf req-bc4994bc-d824-470f-a104-d78f75c1a45e service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:16.204230 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-85c180e0-34ed-49e5-84f5-cc0742bb0fdf req-bc4994bc-d824-470f-a104-d78f75c1a45e service nova] Creating event network-changed:ab7ff115-6093-4813-966f-56337f1c2db6 for instance c44a3421-d825-4b89-9c4e-8aa8112595d2 on hv-cinder-84684 Jun 26 03:13:16.209323 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-85c180e0-34ed-49e5-84f5-cc0742bb0fdf req-bc4994bc-d824-470f-a104-d78f75c1a45e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029011 Jun 26 03:13:16.209916 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 438/885] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:13:16.803260 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3b9cb73e-9ef2-45e4-aca0-4b80ee0b1602 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:16.803887 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3b9cb73e-9ef2-45e4-aca0-4b80ee0b1602 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:16.811099 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b9cb73e-9ef2-45e4-aca0-4b80ee0b1602 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:16.811549 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b9cb73e-9ef2-45e4-aca0-4b80ee0b1602 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:16.812313 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b9cb73e-9ef2-45e4-aca0-4b80ee0b1602 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:16.812753 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b9cb73e-9ef2-45e4-aca0-4b80ee0b1602 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:16.948491 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3b9cb73e-9ef2-45e4-aca0-4b80ee0b1602 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:16.954405 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-48bdb469-9a49-4d84-ab18-c3f6e8c56a20 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:16.955116 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-48bdb469-9a49-4d84-ab18-c3f6e8c56a20 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:16.962372 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-48bdb469-9a49-4d84-ab18-c3f6e8c56a20 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:16.963114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-48bdb469-9a49-4d84-ab18-c3f6e8c56a20 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:16.964070 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-48bdb469-9a49-4d84-ab18-c3f6e8c56a20 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:16.964283 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3b9cb73e-9ef2-45e4-aca0-4b80ee0b1602 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:16.964734 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-48bdb469-9a49-4d84-ab18-c3f6e8c56a20 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:16.965795 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3b9cb73e-9ef2-45e4-aca0-4b80ee0b1602 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:16.966973 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3b9cb73e-9ef2-45e4-aca0-4b80ee0b1602 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1723 microversion: 2.20 time: 0.167676 Jun 26 03:13:16.967523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 448/886] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:16 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:17.133294 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-48bdb469-9a49-4d84-ab18-c3f6e8c56a20 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:17.146692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-48bdb469-9a49-4d84-ab18-c3f6e8c56a20 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1315 microversion: 2.1 time: 0.196784 Jun 26 03:13:17.147285 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 439/887] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:16 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:13:17.984673 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-699f21ae-383c-48d6-ac0b-68e4e666fbc2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:17.985340 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-699f21ae-383c-48d6-ac0b-68e4e666fbc2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:17.992182 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-699f21ae-383c-48d6-ac0b-68e4e666fbc2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:17.992642 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-699f21ae-383c-48d6-ac0b-68e4e666fbc2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:17.993594 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-699f21ae-383c-48d6-ac0b-68e4e666fbc2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:17.994538 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-699f21ae-383c-48d6-ac0b-68e4e666fbc2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:18.163870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-389da4b1-6749-4b12-91dc-8ca3b77430ac tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:18.165120 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-389da4b1-6749-4b12-91dc-8ca3b77430ac tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:18.172024 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-389da4b1-6749-4b12-91dc-8ca3b77430ac tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:18.172481 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-389da4b1-6749-4b12-91dc-8ca3b77430ac tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:18.173263 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-389da4b1-6749-4b12-91dc-8ca3b77430ac tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:18.173705 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-389da4b1-6749-4b12-91dc-8ca3b77430ac tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:18.197931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-699f21ae-383c-48d6-ac0b-68e4e666fbc2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:18.206698 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-699f21ae-383c-48d6-ac0b-68e4e666fbc2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:18.211707 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-699f21ae-383c-48d6-ac0b-68e4e666fbc2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:18.217667 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-699f21ae-383c-48d6-ac0b-68e4e666fbc2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1723 microversion: 2.20 time: 0.236820 Jun 26 03:13:18.218607 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 449/888] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:17 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:18.373409 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-389da4b1-6749-4b12-91dc-8ca3b77430ac tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:18.381041 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-389da4b1-6749-4b12-91dc-8ca3b77430ac tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1465 microversion: 2.1 time: 0.221060 Jun 26 03:13:18.381601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 440/889] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:18 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1465 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:18.419435 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-37bd58f8-dd8e-4e16-8746-c69c1e295f07 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:18.419932 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-37bd58f8-dd8e-4e16-8746-c69c1e295f07 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:18.425865 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-37bd58f8-dd8e-4e16-8746-c69c1e295f07 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:18.426357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-37bd58f8-dd8e-4e16-8746-c69c1e295f07 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:18.427124 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-37bd58f8-dd8e-4e16-8746-c69c1e295f07 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:18.427564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-37bd58f8-dd8e-4e16-8746-c69c1e295f07 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:18.451536 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-37bd58f8-dd8e-4e16-8746-c69c1e295f07 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:13:18.522539 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-37bd58f8-dd8e-4e16-8746-c69c1e295f07 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 204 len: 0 microversion: 2.1 time: 0.107085 Jun 26 03:13:18.523124 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 450/890] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:13:18 2022] DELETE /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:13:18.531724 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b11605af-7e9a-4db3-b9ab-271547ad002e tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:18.532343 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b11605af-7e9a-4db3-b9ab-271547ad002e tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:18.538369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b11605af-7e9a-4db3-b9ab-271547ad002e tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:18.538828 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b11605af-7e9a-4db3-b9ab-271547ad002e tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:18.539593 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b11605af-7e9a-4db3-b9ab-271547ad002e tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:18.540038 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b11605af-7e9a-4db3-b9ab-271547ad002e tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:18.668007 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b11605af-7e9a-4db3-b9ab-271547ad002e tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:18.675407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b11605af-7e9a-4db3-b9ab-271547ad002e tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1471 microversion: 2.1 time: 0.147924 Jun 26 03:13:18.675971 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 441/891] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:18 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1471 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:19.135372 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-648accca-e39d-4e01-b598-2ab9157e9dd0 req-edfc7571-e0a9-4d49-9bfa-591473ca8882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee71e3f2-a415-4000-97d4-290a4675ee4e", "name": "network-vif-unplugged", "status": "completed", "tag": "7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:19.144624 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-648accca-e39d-4e01-b598-2ab9157e9dd0 req-edfc7571-e0a9-4d49-9bfa-591473ca8882 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:19.145074 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-648accca-e39d-4e01-b598-2ab9157e9dd0 req-edfc7571-e0a9-4d49-9bfa-591473ca8882 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:19.158925 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-648accca-e39d-4e01-b598-2ab9157e9dd0 req-edfc7571-e0a9-4d49-9bfa-591473ca8882 service nova] Creating event network-vif-unplugged:7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6 for instance ee71e3f2-a415-4000-97d4-290a4675ee4e on hv-cinder-84684 Jun 26 03:13:19.163819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-648accca-e39d-4e01-b598-2ab9157e9dd0 req-edfc7571-e0a9-4d49-9bfa-591473ca8882 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032998 Jun 26 03:13:19.164440 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 451/892] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:13:19.235533 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-da6accbf-76e0-4f5c-bb7c-ef5243ebc0f3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:19.236147 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-da6accbf-76e0-4f5c-bb7c-ef5243ebc0f3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:19.242616 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-da6accbf-76e0-4f5c-bb7c-ef5243ebc0f3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:19.243074 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-da6accbf-76e0-4f5c-bb7c-ef5243ebc0f3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:19.243843 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-da6accbf-76e0-4f5c-bb7c-ef5243ebc0f3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:19.244285 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-da6accbf-76e0-4f5c-bb7c-ef5243ebc0f3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:19.369861 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-da6accbf-76e0-4f5c-bb7c-ef5243ebc0f3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:19.377750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-da6accbf-76e0-4f5c-bb7c-ef5243ebc0f3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:19.379556 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-da6accbf-76e0-4f5c-bb7c-ef5243ebc0f3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:19.380705 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-da6accbf-76e0-4f5c-bb7c-ef5243ebc0f3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1723 microversion: 2.20 time: 0.149151 Jun 26 03:13:19.381264 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 442/893] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:19 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:19.693284 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-321660c6-a35a-43ff-9bb0-360a9c2dfc16 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:19.693986 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-321660c6-a35a-43ff-9bb0-360a9c2dfc16 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:19.700862 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-321660c6-a35a-43ff-9bb0-360a9c2dfc16 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:19.701321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-321660c6-a35a-43ff-9bb0-360a9c2dfc16 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:19.702141 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-321660c6-a35a-43ff-9bb0-360a9c2dfc16 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:19.702628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-321660c6-a35a-43ff-9bb0-360a9c2dfc16 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:19.835392 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-321660c6-a35a-43ff-9bb0-360a9c2dfc16 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:19.842848 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-321660c6-a35a-43ff-9bb0-360a9c2dfc16 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1471 microversion: 2.1 time: 0.153818 Jun 26 03:13:19.843443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 452/894] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:19 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:20.399993 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e9c63e86-5a52-4ca3-b3cf-864e7952a37e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:20.400579 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e9c63e86-5a52-4ca3-b3cf-864e7952a37e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:20.407507 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e9c63e86-5a52-4ca3-b3cf-864e7952a37e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:20.407954 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e9c63e86-5a52-4ca3-b3cf-864e7952a37e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:20.408708 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e9c63e86-5a52-4ca3-b3cf-864e7952a37e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:20.409143 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e9c63e86-5a52-4ca3-b3cf-864e7952a37e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:20.427159 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=100 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:20.535678 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e9c63e86-5a52-4ca3-b3cf-864e7952a37e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:20.543471 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e9c63e86-5a52-4ca3-b3cf-864e7952a37e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:20.544964 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e9c63e86-5a52-4ca3-b3cf-864e7952a37e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:20.546131 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e9c63e86-5a52-4ca3-b3cf-864e7952a37e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1723 microversion: 2.20 time: 0.150256 Jun 26 03:13:20.546684 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 443/895] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:20 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:20.859828 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e6b8d356-2cc8-43c5-9a44-0dde5b1c4985 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:20.860479 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e6b8d356-2cc8-43c5-9a44-0dde5b1c4985 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:20.866987 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e6b8d356-2cc8-43c5-9a44-0dde5b1c4985 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:20.867439 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e6b8d356-2cc8-43c5-9a44-0dde5b1c4985 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:20.868204 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e6b8d356-2cc8-43c5-9a44-0dde5b1c4985 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:20.868644 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e6b8d356-2cc8-43c5-9a44-0dde5b1c4985 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:20.996668 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e6b8d356-2cc8-43c5-9a44-0dde5b1c4985 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:21.004360 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e6b8d356-2cc8-43c5-9a44-0dde5b1c4985 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1471 microversion: 2.1 time: 0.148156 Jun 26 03:13:21.004922 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 453/896] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:20 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:21.564278 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-70f644d5-d014-45dd-8df9-315e5c2f8b39 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:21.564816 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-70f644d5-d014-45dd-8df9-315e5c2f8b39 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:21.571266 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70f644d5-d014-45dd-8df9-315e5c2f8b39 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:21.571726 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70f644d5-d014-45dd-8df9-315e5c2f8b39 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:21.572495 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70f644d5-d014-45dd-8df9-315e5c2f8b39 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:21.572940 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70f644d5-d014-45dd-8df9-315e5c2f8b39 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:21.699409 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-70f644d5-d014-45dd-8df9-315e5c2f8b39 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:21.707880 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-70f644d5-d014-45dd-8df9-315e5c2f8b39 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:21.709405 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-70f644d5-d014-45dd-8df9-315e5c2f8b39 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:21.710607 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-70f644d5-d014-45dd-8df9-315e5c2f8b39 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1726 microversion: 2.20 time: 0.150359 Jun 26 03:13:21.711167 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 444/897] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:21 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:21.728578 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-448b4ab5-0dc9-49be-9117-5e60c8f4c26e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47af1ed7-e3bb-4480-b604-cdf65076ca79"}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:21.730309 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-448b4ab5-0dc9-49be-9117-5e60c8f4c26e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:21.736325 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-448b4ab5-0dc9-49be-9117-5e60c8f4c26e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:21.736775 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-448b4ab5-0dc9-49be-9117-5e60c8f4c26e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:21.737531 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-448b4ab5-0dc9-49be-9117-5e60c8f4c26e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:21.737967 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-448b4ab5-0dc9-49be-9117-5e60c8f4c26e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:21.993799 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-448b4ab5-0dc9-49be-9117-5e60c8f4c26e tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "POST /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.269168 Jun 26 03:13:21.994507 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 454/898] 10.222.0.13 () {62 vars in 1363 bytes} [Sun Jun 26 03:13:21 2022] POST /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/os-volume_attachments => generated 188 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 26 03:13:22.021389 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-70155549-04ab-4012-ac60-53349b649dd6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:22.022014 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-70155549-04ab-4012-ac60-53349b649dd6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:22.030137 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70155549-04ab-4012-ac60-53349b649dd6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:22.032614 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70155549-04ab-4012-ac60-53349b649dd6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:22.033420 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70155549-04ab-4012-ac60-53349b649dd6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:22.033875 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-70155549-04ab-4012-ac60-53349b649dd6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:22.122670 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2a2c62c1-0517-4229-82ef-3aa388f94718 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:22.123165 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2a2c62c1-0517-4229-82ef-3aa388f94718 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:22.129688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a2c62c1-0517-4229-82ef-3aa388f94718 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:22.130287 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a2c62c1-0517-4229-82ef-3aa388f94718 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:22.131063 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a2c62c1-0517-4229-82ef-3aa388f94718 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:22.131623 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2a2c62c1-0517-4229-82ef-3aa388f94718 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:22.151390 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:22.260642 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-70155549-04ab-4012-ac60-53349b649dd6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052955a0039745a9b93cb81164501501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf9d500fd3a41cdb218a5f3377c68ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:22.268333 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-70155549-04ab-4012-ac60-53349b649dd6 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 200 len: 1471 microversion: 2.1 time: 0.250708 Jun 26 03:13:22.276476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 445/899] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:22 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 1471 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:13:22.384880 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2a2c62c1-0517-4229-82ef-3aa388f94718 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/os-volume_attachments/47af1ed7-e3bb-4480-b604-cdf65076ca79" status: 202 len: 0 microversion: 2.20 time: 0.266762 Jun 26 03:13:22.386097 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 455/900] 10.222.0.13 () {60 vars in 1456 bytes} [Sun Jun 26 03:13:22 2022] DELETE /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/os-volume_attachments/47af1ed7-e3bb-4480-b604-cdf65076ca79 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 26 03:13:22.441972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9ba645b7-dd37-4a16-af76-f081b1b5d794 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:22.442837 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9ba645b7-dd37-4a16-af76-f081b1b5d794 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:22.449396 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ba645b7-dd37-4a16-af76-f081b1b5d794 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:22.449851 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ba645b7-dd37-4a16-af76-f081b1b5d794 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:22.450651 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ba645b7-dd37-4a16-af76-f081b1b5d794 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:22.451091 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9ba645b7-dd37-4a16-af76-f081b1b5d794 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:22.530997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9ba645b7-dd37-4a16-af76-f081b1b5d794 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "POST /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/action" status: 202 len: 0 microversion: 2.20 time: 0.092870 Jun 26 03:13:22.541128 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f47ad101-b5b7-4a39-a947-55ec649e1a43 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:22.541899 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f47ad101-b5b7-4a39-a947-55ec649e1a43 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:22.546831 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 446/901] 10.222.0.13 () {62 vars in 1318 bytes} [Sun Jun 26 03:13:22 2022] POST /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:13:22.548562 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f47ad101-b5b7-4a39-a947-55ec649e1a43 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:22.549230 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f47ad101-b5b7-4a39-a947-55ec649e1a43 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:22.550221 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f47ad101-b5b7-4a39-a947-55ec649e1a43 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:22.550678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f47ad101-b5b7-4a39-a947-55ec649e1a43 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:22.587365 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-b2b1e003-dbb3-472c-88e2-73eec07459e6 req-3ffea692-a875-4d0c-88c5-11bd720c9b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd", "name": "network-vif-deleted", "tag": "619dd00f-2ea8-4823-b3cf-9aefd955dab8"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:22.601009 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-b2b1e003-dbb3-472c-88e2-73eec07459e6 req-3ffea692-a875-4d0c-88c5-11bd720c9b9c service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:22.601816 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-b2b1e003-dbb3-472c-88e2-73eec07459e6 req-3ffea692-a875-4d0c-88c5-11bd720c9b9c service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:22.614151 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-b2b1e003-dbb3-472c-88e2-73eec07459e6 req-3ffea692-a875-4d0c-88c5-11bd720c9b9c service nova] Creating event network-vif-deleted:619dd00f-2ea8-4823-b3cf-9aefd955dab8 for instance 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd on hv-cinder-84684 Jun 26 03:13:22.623871 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-b2b1e003-dbb3-472c-88e2-73eec07459e6 req-3ffea692-a875-4d0c-88c5-11bd720c9b9c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039927 Jun 26 03:13:22.625500 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 447/902] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:13:22.983049 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f47ad101-b5b7-4a39-a947-55ec649e1a43 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:22.990949 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f47ad101-b5b7-4a39-a947-55ec649e1a43 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:22.992454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f47ad101-b5b7-4a39-a947-55ec649e1a43 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:22.993629 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f47ad101-b5b7-4a39-a947-55ec649e1a43 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1674 microversion: 2.20 time: 0.457661 Jun 26 03:13:22.994213 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 456/903] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:22 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1674 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:23.287076 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3a3432df-94bb-4a79-bf94-9c8aefbd0876 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:23.287939 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3a3432df-94bb-4a79-bf94-9c8aefbd0876 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] [instance: 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:23.295301 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3a3432df-94bb-4a79-bf94-9c8aefbd0876 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:23.295752 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3a3432df-94bb-4a79-bf94-9c8aefbd0876 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:23.296554 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3a3432df-94bb-4a79-bf94-9c8aefbd0876 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:23.296990 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3a3432df-94bb-4a79-bf94-9c8aefbd0876 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:23.310376 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-3a3432df-94bb-4a79-bf94-9c8aefbd0876 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] HTTP exception thrown: Instance 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd could not be found. Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3a3432df-94bb-4a79-bf94-9c8aefbd0876 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Request method failure captured: Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd HTTP/1.1 Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8683v9lG3Pj5MbObkV0N254JxCl8LL-wy87ppTnKDTWeg-LhghlgQiEywnmhcEWAhkRiVQWouCzFau0VtCvX2aOX21rCOU6YcPYPuYHyADbYYzv-hSa7GYAGjknrFNQB2OEPXpqmFoycjQ3Rmrbjg4Z_ryLOjHuH2pjbgNp3Q_bIWM Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: fbf9d500fd3a41cdb218a5f3377c68ea Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-VolumesNegativeTest-1194216081 Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:13:23.311997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:13:23.313637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fbf9d500fd3a41cdb218a5f3377c68ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fbf9d500fd3a41cdb218a5f3377c68ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fbf9d500fd3a41cdb218a5f3377c68ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fbf9d500fd3a41cdb218a5f3377c68ea"}]}] Jun 26 03:13:23.313637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-VolumesNegativeTest-1194216081 Jun 26 03:13:23.313637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: fbf9d500fd3a41cdb218a5f3377c68ea Jun 26 03:13:23.313637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-VolumesNegativeTest-1194216081 Jun 26 03:13:23.313637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-VolumesNegativeTest-1194216081-project Jun 26 03:13:23.313637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:13:23.313637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:13:23.313637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 052955a0039745a9b93cb81164501501 Jun 26 03:13:23.313637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-VolumesNegativeTest-1194216081-project Jun 26 03:13:23.313637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:13:23.313637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd could not be found. Jun 26 03:13:23.313637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd'} Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd could not be found. Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:13:23.314656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd could not be found. Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd could not be found. Jun 26 03:13:23.316239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:13:23.317628 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3a3432df-94bb-4a79-bf94-9c8aefbd0876 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] Returning 404 to user: Instance 2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:13:23.317628 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3a3432df-94bb-4a79-bf94-9c8aefbd0876 tempest-VolumesNegativeTest-1194216081 tempest-VolumesNegativeTest-1194216081-project] 10.222.0.13 "GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd" status: 404 len: 111 microversion: 2.1 time: 0.031759 Jun 26 03:13:23.317628 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 448/904] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:13:23 2022] GET /compute/v2.1/servers/2aa89b84-b7dc-4bfc-ab1a-1d0ba65c62cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:13:24.013180 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-56651172-336e-43ff-b36e-c094dcd46ead tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:24.013800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-56651172-336e-43ff-b36e-c094dcd46ead tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:24.020295 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-56651172-336e-43ff-b36e-c094dcd46ead tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:24.020750 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-56651172-336e-43ff-b36e-c094dcd46ead tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:24.021520 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-56651172-336e-43ff-b36e-c094dcd46ead tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:24.021969 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-56651172-336e-43ff-b36e-c094dcd46ead tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:24.191341 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-56651172-336e-43ff-b36e-c094dcd46ead tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:24.204485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-56651172-336e-43ff-b36e-c094dcd46ead tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:24.205018 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-56651172-336e-43ff-b36e-c094dcd46ead tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:24.206297 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-56651172-336e-43ff-b36e-c094dcd46ead tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.197502 Jun 26 03:13:24.206889 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 457/905] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:24 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:25.224872 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-31455488-77a7-433f-902a-6c623245d7ef tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:25.226215 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-31455488-77a7-433f-902a-6c623245d7ef tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:25.249647 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31455488-77a7-433f-902a-6c623245d7ef tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:25.252104 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31455488-77a7-433f-902a-6c623245d7ef tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:25.258156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31455488-77a7-433f-902a-6c623245d7ef tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:25.259879 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31455488-77a7-433f-902a-6c623245d7ef tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:25.504968 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-31455488-77a7-433f-902a-6c623245d7ef tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:25.516049 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-31455488-77a7-433f-902a-6c623245d7ef tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:25.521857 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-31455488-77a7-433f-902a-6c623245d7ef tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:25.523470 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-31455488-77a7-433f-902a-6c623245d7ef tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.302124 Jun 26 03:13:25.534977 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 449/906] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:25 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:26.543495 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-422f9e38-e731-4be0-a873-09302dcf5736 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:26.544019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-422f9e38-e731-4be0-a873-09302dcf5736 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:26.550656 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-422f9e38-e731-4be0-a873-09302dcf5736 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:26.551105 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-422f9e38-e731-4be0-a873-09302dcf5736 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:26.551875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-422f9e38-e731-4be0-a873-09302dcf5736 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:26.552305 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-422f9e38-e731-4be0-a873-09302dcf5736 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:26.696841 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-422f9e38-e731-4be0-a873-09302dcf5736 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:26.705666 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-422f9e38-e731-4be0-a873-09302dcf5736 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:26.707472 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-422f9e38-e731-4be0-a873-09302dcf5736 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:26.708627 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-422f9e38-e731-4be0-a873-09302dcf5736 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.169537 Jun 26 03:13:26.709387 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 458/907] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:26 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:27.726493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2893f58f-69c8-4d6c-a3f8-4a507d8cedc3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:27.727090 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2893f58f-69c8-4d6c-a3f8-4a507d8cedc3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:27.734673 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2893f58f-69c8-4d6c-a3f8-4a507d8cedc3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:27.735222 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2893f58f-69c8-4d6c-a3f8-4a507d8cedc3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:27.736240 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2893f58f-69c8-4d6c-a3f8-4a507d8cedc3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:27.736683 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2893f58f-69c8-4d6c-a3f8-4a507d8cedc3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:27.910164 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2893f58f-69c8-4d6c-a3f8-4a507d8cedc3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:27.928880 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2893f58f-69c8-4d6c-a3f8-4a507d8cedc3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:27.931255 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2893f58f-69c8-4d6c-a3f8-4a507d8cedc3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:27.932520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2893f58f-69c8-4d6c-a3f8-4a507d8cedc3 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.209878 Jun 26 03:13:27.933087 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 450/908] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:27 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:28.930173 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-faa3aec8-cf07-405f-bb12-fe1ec6c384d5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:28.930696 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-faa3aec8-cf07-405f-bb12-fe1ec6c384d5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:28.937403 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-faa3aec8-cf07-405f-bb12-fe1ec6c384d5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:28.937863 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-faa3aec8-cf07-405f-bb12-fe1ec6c384d5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:28.938850 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-faa3aec8-cf07-405f-bb12-fe1ec6c384d5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:28.939295 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-faa3aec8-cf07-405f-bb12-fe1ec6c384d5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:28.950329 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5e582beb-7b93-4c8c-8d82-095b42129258 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:28.951585 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5e582beb-7b93-4c8c-8d82-095b42129258 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:28.959403 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5e582beb-7b93-4c8c-8d82-095b42129258 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:28.960012 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5e582beb-7b93-4c8c-8d82-095b42129258 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:28.961141 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5e582beb-7b93-4c8c-8d82-095b42129258 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:28.961750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5e582beb-7b93-4c8c-8d82-095b42129258 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:29.113371 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-faa3aec8-cf07-405f-bb12-fe1ec6c384d5 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/ips" status: 200 len: 145 microversion: 2.1 time: 0.187286 Jun 26 03:13:29.113952 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 459/909] 10.222.0.13 () {58 vars in 1247 bytes} [Sun Jun 26 03:13:28 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/ips => generated 145 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:13:29.122981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5e582beb-7b93-4c8c-8d82-095b42129258 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:29.132060 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5e582beb-7b93-4c8c-8d82-095b42129258 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:29.133820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5e582beb-7b93-4c8c-8d82-095b42129258 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:29.135474 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5e582beb-7b93-4c8c-8d82-095b42129258 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.189070 Jun 26 03:13:29.136440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 451/910] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:28 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:30.155137 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6708625c-f511-4649-baa0-8c1975e6d804 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:30.155731 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-6708625c-f511-4649-baa0-8c1975e6d804 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:30.162255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6708625c-f511-4649-baa0-8c1975e6d804 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:30.162735 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6708625c-f511-4649-baa0-8c1975e6d804 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:30.163536 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6708625c-f511-4649-baa0-8c1975e6d804 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:30.164002 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6708625c-f511-4649-baa0-8c1975e6d804 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:30.304735 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6708625c-f511-4649-baa0-8c1975e6d804 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:30.313344 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6708625c-f511-4649-baa0-8c1975e6d804 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:30.315006 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6708625c-f511-4649-baa0-8c1975e6d804 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:30.316342 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6708625c-f511-4649-baa0-8c1975e6d804 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.165402 Jun 26 03:13:30.316910 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 460/911] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:30 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:30.462345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6d5477f8-6d16-4303-a0fa-d0b3218bf983 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2defff8-42af-42cf-ba0c-2e4fcf43a724"}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:30.463452 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-6d5477f8-6d16-4303-a0fa-d0b3218bf983 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:30.470177 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6d5477f8-6d16-4303-a0fa-d0b3218bf983 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:30.470631 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6d5477f8-6d16-4303-a0fa-d0b3218bf983 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:30.471397 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6d5477f8-6d16-4303-a0fa-d0b3218bf983 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:30.471835 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-6d5477f8-6d16-4303-a0fa-d0b3218bf983 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:31.335409 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e90dab49-a0f5-4fc5-a5f3-8081354cf31a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:31.336097 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e90dab49-a0f5-4fc5-a5f3-8081354cf31a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:31.343324 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e90dab49-a0f5-4fc5-a5f3-8081354cf31a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:31.343774 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e90dab49-a0f5-4fc5-a5f3-8081354cf31a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:31.344551 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e90dab49-a0f5-4fc5-a5f3-8081354cf31a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:31.344983 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e90dab49-a0f5-4fc5-a5f3-8081354cf31a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:31.486942 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e90dab49-a0f5-4fc5-a5f3-8081354cf31a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:31.497031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e90dab49-a0f5-4fc5-a5f3-8081354cf31a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:31.498554 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e90dab49-a0f5-4fc5-a5f3-8081354cf31a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:31.499713 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e90dab49-a0f5-4fc5-a5f3-8081354cf31a tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.168370 Jun 26 03:13:31.500260 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 461/912] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:31 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:32.518750 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-bd7521af-af3f-4180-89ec-15ff3be57247 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:32.519511 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-bd7521af-af3f-4180-89ec-15ff3be57247 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:32.526463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd7521af-af3f-4180-89ec-15ff3be57247 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:32.526938 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd7521af-af3f-4180-89ec-15ff3be57247 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:32.527704 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd7521af-af3f-4180-89ec-15ff3be57247 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:32.528146 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd7521af-af3f-4180-89ec-15ff3be57247 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:32.655142 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bd7521af-af3f-4180-89ec-15ff3be57247 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:32.663024 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bd7521af-af3f-4180-89ec-15ff3be57247 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:32.664542 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bd7521af-af3f-4180-89ec-15ff3be57247 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:32.665708 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-bd7521af-af3f-4180-89ec-15ff3be57247 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.150871 Jun 26 03:13:32.666332 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 462/913] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:32 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:33.683868 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fdad7f46-0955-4300-b8fe-cc60e17dc456 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:33.684478 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fdad7f46-0955-4300-b8fe-cc60e17dc456 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:33.690751 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fdad7f46-0955-4300-b8fe-cc60e17dc456 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:33.691204 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fdad7f46-0955-4300-b8fe-cc60e17dc456 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:33.691967 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fdad7f46-0955-4300-b8fe-cc60e17dc456 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:33.692406 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fdad7f46-0955-4300-b8fe-cc60e17dc456 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:33.822022 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fdad7f46-0955-4300-b8fe-cc60e17dc456 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:33.829939 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fdad7f46-0955-4300-b8fe-cc60e17dc456 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:33.831504 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fdad7f46-0955-4300-b8fe-cc60e17dc456 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:33.832643 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fdad7f46-0955-4300-b8fe-cc60e17dc456 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.152732 Jun 26 03:13:33.833190 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 463/914] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:33 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:34.851416 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a0999c4e-3908-4a60-9b29-1cc97bf40d48 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:34.852077 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a0999c4e-3908-4a60-9b29-1cc97bf40d48 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:34.859046 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0999c4e-3908-4a60-9b29-1cc97bf40d48 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:34.859503 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0999c4e-3908-4a60-9b29-1cc97bf40d48 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:34.860268 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0999c4e-3908-4a60-9b29-1cc97bf40d48 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:34.860711 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a0999c4e-3908-4a60-9b29-1cc97bf40d48 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:34.999490 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a0999c4e-3908-4a60-9b29-1cc97bf40d48 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:35.007503 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a0999c4e-3908-4a60-9b29-1cc97bf40d48 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:35.009011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a0999c4e-3908-4a60-9b29-1cc97bf40d48 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:35.010293 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a0999c4e-3908-4a60-9b29-1cc97bf40d48 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.162689 Jun 26 03:13:35.010840 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 464/915] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:34 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:36.028616 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6d9639a7-6f78-418c-89bc-545e5e368c5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:36.029274 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-6d9639a7-6f78-418c-89bc-545e5e368c5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:36.035688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6d9639a7-6f78-418c-89bc-545e5e368c5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:36.036144 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6d9639a7-6f78-418c-89bc-545e5e368c5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:36.036908 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6d9639a7-6f78-418c-89bc-545e5e368c5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:36.037351 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6d9639a7-6f78-418c-89bc-545e5e368c5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:36.171474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6d9639a7-6f78-418c-89bc-545e5e368c5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:36.179432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6d9639a7-6f78-418c-89bc-545e5e368c5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:36.180932 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6d9639a7-6f78-418c-89bc-545e5e368c5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:36.182648 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6d9639a7-6f78-418c-89bc-545e5e368c5f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.157947 Jun 26 03:13:36.183198 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 465/916] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:36 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:37.200719 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9a1abd51-12b5-4d03-8116-f10af4dd8cd4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:37.201545 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9a1abd51-12b5-4d03-8116-f10af4dd8cd4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:37.208076 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9a1abd51-12b5-4d03-8116-f10af4dd8cd4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:37.208536 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9a1abd51-12b5-4d03-8116-f10af4dd8cd4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:37.209317 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9a1abd51-12b5-4d03-8116-f10af4dd8cd4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:37.210022 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9a1abd51-12b5-4d03-8116-f10af4dd8cd4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:37.354773 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9a1abd51-12b5-4d03-8116-f10af4dd8cd4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:37.366791 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9a1abd51-12b5-4d03-8116-f10af4dd8cd4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:37.368759 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9a1abd51-12b5-4d03-8116-f10af4dd8cd4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:37.369969 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9a1abd51-12b5-4d03-8116-f10af4dd8cd4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.173200 Jun 26 03:13:37.370550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 466/917] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:37 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:38.388878 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-11e1d383-a4d0-42cc-8dc6-a6be7a6f5513 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:38.389497 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-11e1d383-a4d0-42cc-8dc6-a6be7a6f5513 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:38.395862 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-11e1d383-a4d0-42cc-8dc6-a6be7a6f5513 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:38.396314 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-11e1d383-a4d0-42cc-8dc6-a6be7a6f5513 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:38.397105 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-11e1d383-a4d0-42cc-8dc6-a6be7a6f5513 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:38.397546 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-11e1d383-a4d0-42cc-8dc6-a6be7a6f5513 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:38.522303 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-11e1d383-a4d0-42cc-8dc6-a6be7a6f5513 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:38.530121 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-11e1d383-a4d0-42cc-8dc6-a6be7a6f5513 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:38.531572 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-11e1d383-a4d0-42cc-8dc6-a6be7a6f5513 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:38.532727 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-11e1d383-a4d0-42cc-8dc6-a6be7a6f5513 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.148283 Jun 26 03:13:38.533285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 467/918] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:38 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:39.551314 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c7a31c89-53c5-4b4b-ae0e-f6b45026a259 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:39.551944 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c7a31c89-53c5-4b4b-ae0e-f6b45026a259 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:39.558420 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c7a31c89-53c5-4b4b-ae0e-f6b45026a259 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:39.558877 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c7a31c89-53c5-4b4b-ae0e-f6b45026a259 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:39.559641 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c7a31c89-53c5-4b4b-ae0e-f6b45026a259 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:39.560080 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c7a31c89-53c5-4b4b-ae0e-f6b45026a259 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:39.688679 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c7a31c89-53c5-4b4b-ae0e-f6b45026a259 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:39.696501 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c7a31c89-53c5-4b4b-ae0e-f6b45026a259 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:39.698700 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c7a31c89-53c5-4b4b-ae0e-f6b45026a259 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:39.699861 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c7a31c89-53c5-4b4b-ae0e-f6b45026a259 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.152420 Jun 26 03:13:39.700415 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 468/919] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:39 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:40.467671 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=39 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:40.544656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:40.720033 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-32cf9473-a18b-4663-8f52-3cfce1bd4ed6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:40.720574 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-32cf9473-a18b-4663-8f52-3cfce1bd4ed6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:40.726997 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-32cf9473-a18b-4663-8f52-3cfce1bd4ed6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:40.727459 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-32cf9473-a18b-4663-8f52-3cfce1bd4ed6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:40.728225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-32cf9473-a18b-4663-8f52-3cfce1bd4ed6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:40.729231 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-32cf9473-a18b-4663-8f52-3cfce1bd4ed6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:40.855131 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-32cf9473-a18b-4663-8f52-3cfce1bd4ed6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:40.863059 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-32cf9473-a18b-4663-8f52-3cfce1bd4ed6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:40.864564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-32cf9473-a18b-4663-8f52-3cfce1bd4ed6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:40.865726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-32cf9473-a18b-4663-8f52-3cfce1bd4ed6 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.149720 Jun 26 03:13:40.866392 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 469/920] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:40 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:41.883476 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-5f673def-5768-44a8-bb1b-423a527eeecd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:41.884088 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-5f673def-5768-44a8-bb1b-423a527eeecd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:41.890672 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5f673def-5768-44a8-bb1b-423a527eeecd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:41.891124 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5f673def-5768-44a8-bb1b-423a527eeecd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:41.891880 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5f673def-5768-44a8-bb1b-423a527eeecd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:41.892316 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5f673def-5768-44a8-bb1b-423a527eeecd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:41.896110 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:42.026263 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-5f673def-5768-44a8-bb1b-423a527eeecd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:42.034103 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-5f673def-5768-44a8-bb1b-423a527eeecd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:42.035613 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-5f673def-5768-44a8-bb1b-423a527eeecd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:42.036758 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-5f673def-5768-44a8-bb1b-423a527eeecd tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.157439 Jun 26 03:13:42.037329 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 470/921] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:41 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:43.055573 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fb0789a7-5ce2-4c85-9508-51ad77ef34f2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:43.056235 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fb0789a7-5ce2-4c85-9508-51ad77ef34f2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:43.063179 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb0789a7-5ce2-4c85-9508-51ad77ef34f2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:43.063629 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb0789a7-5ce2-4c85-9508-51ad77ef34f2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:43.064386 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb0789a7-5ce2-4c85-9508-51ad77ef34f2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:43.064821 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb0789a7-5ce2-4c85-9508-51ad77ef34f2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:43.191729 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fb0789a7-5ce2-4c85-9508-51ad77ef34f2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:43.199785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fb0789a7-5ce2-4c85-9508-51ad77ef34f2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:43.201271 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fb0789a7-5ce2-4c85-9508-51ad77ef34f2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:43.202445 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fb0789a7-5ce2-4c85-9508-51ad77ef34f2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.150720 Jun 26 03:13:43.202995 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 471/922] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:43 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:44.220490 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f6103285-d269-4c45-af92-f21547851c97 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:44.221177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f6103285-d269-4c45-af92-f21547851c97 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:44.223415 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:44.228762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f6103285-d269-4c45-af92-f21547851c97 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:44.229224 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f6103285-d269-4c45-af92-f21547851c97 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:44.230001 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f6103285-d269-4c45-af92-f21547851c97 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:44.230486 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f6103285-d269-4c45-af92-f21547851c97 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:44.362378 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f6103285-d269-4c45-af92-f21547851c97 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:44.370692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f6103285-d269-4c45-af92-f21547851c97 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:44.372185 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f6103285-d269-4c45-af92-f21547851c97 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:44.373333 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f6103285-d269-4c45-af92-f21547851c97 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.156796 Jun 26 03:13:44.373875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 472/923] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:44 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:45.391769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1976c5fc-ab08-4032-b82a-466c8cb31842 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:45.392424 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1976c5fc-ab08-4032-b82a-466c8cb31842 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:45.398831 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1976c5fc-ab08-4032-b82a-466c8cb31842 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:45.399297 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1976c5fc-ab08-4032-b82a-466c8cb31842 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:45.400697 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1976c5fc-ab08-4032-b82a-466c8cb31842 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:45.401156 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1976c5fc-ab08-4032-b82a-466c8cb31842 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:45.526562 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1976c5fc-ab08-4032-b82a-466c8cb31842 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:45.534333 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1976c5fc-ab08-4032-b82a-466c8cb31842 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:45.535838 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1976c5fc-ab08-4032-b82a-466c8cb31842 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:45.536984 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1976c5fc-ab08-4032-b82a-466c8cb31842 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.149150 Jun 26 03:13:45.537537 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 473/924] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:45 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:46.556293 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-17aee9eb-1dee-4664-9e00-4d1d1ae521be tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:46.557569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-17aee9eb-1dee-4664-9e00-4d1d1ae521be tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:46.564532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17aee9eb-1dee-4664-9e00-4d1d1ae521be tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:46.565308 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17aee9eb-1dee-4664-9e00-4d1d1ae521be tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:46.566398 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17aee9eb-1dee-4664-9e00-4d1d1ae521be tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:46.567004 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17aee9eb-1dee-4664-9e00-4d1d1ae521be tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:46.698614 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-17aee9eb-1dee-4664-9e00-4d1d1ae521be tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:46.706582 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-17aee9eb-1dee-4664-9e00-4d1d1ae521be tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:46.708323 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-17aee9eb-1dee-4664-9e00-4d1d1ae521be tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:46.709817 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-17aee9eb-1dee-4664-9e00-4d1d1ae521be tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.158288 Jun 26 03:13:46.720862 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 474/925] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:46 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:47.728086 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-bcc59595-08a9-48f8-a16f-256dbcc5cd71 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:47.729259 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-bcc59595-08a9-48f8-a16f-256dbcc5cd71 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:47.735814 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bcc59595-08a9-48f8-a16f-256dbcc5cd71 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:47.736263 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bcc59595-08a9-48f8-a16f-256dbcc5cd71 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:47.737023 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bcc59595-08a9-48f8-a16f-256dbcc5cd71 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:47.737460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bcc59595-08a9-48f8-a16f-256dbcc5cd71 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:47.867491 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bcc59595-08a9-48f8-a16f-256dbcc5cd71 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:47.875429 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bcc59595-08a9-48f8-a16f-256dbcc5cd71 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:47.876930 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bcc59595-08a9-48f8-a16f-256dbcc5cd71 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:47.878113 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-bcc59595-08a9-48f8-a16f-256dbcc5cd71 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.154099 Jun 26 03:13:47.878687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 475/926] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:47 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:48.897677 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ba448d2b-8fa1-4ed7-8b97-80e3d231eaf7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:48.898390 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ba448d2b-8fa1-4ed7-8b97-80e3d231eaf7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:48.904829 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ba448d2b-8fa1-4ed7-8b97-80e3d231eaf7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:48.905285 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ba448d2b-8fa1-4ed7-8b97-80e3d231eaf7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:48.906072 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ba448d2b-8fa1-4ed7-8b97-80e3d231eaf7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:48.906521 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ba448d2b-8fa1-4ed7-8b97-80e3d231eaf7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:49.038170 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ba448d2b-8fa1-4ed7-8b97-80e3d231eaf7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:49.046538 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ba448d2b-8fa1-4ed7-8b97-80e3d231eaf7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:49.048047 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ba448d2b-8fa1-4ed7-8b97-80e3d231eaf7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:49.049193 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ba448d2b-8fa1-4ed7-8b97-80e3d231eaf7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.155367 Jun 26 03:13:49.049785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 476/927] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:48 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:50.068347 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-86113554-4d3e-42a9-8cc5-7030e6e05c6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:50.069057 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-86113554-4d3e-42a9-8cc5-7030e6e05c6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:50.076358 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86113554-4d3e-42a9-8cc5-7030e6e05c6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:50.076809 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86113554-4d3e-42a9-8cc5-7030e6e05c6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:50.077587 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86113554-4d3e-42a9-8cc5-7030e6e05c6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:50.078024 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86113554-4d3e-42a9-8cc5-7030e6e05c6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:50.218224 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-86113554-4d3e-42a9-8cc5-7030e6e05c6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:50.226224 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-86113554-4d3e-42a9-8cc5-7030e6e05c6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:50.227717 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-86113554-4d3e-42a9-8cc5-7030e6e05c6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:50.228864 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-86113554-4d3e-42a9-8cc5-7030e6e05c6b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.164515 Jun 26 03:13:50.229407 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 477/928] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:50 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:50.687448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6d5477f8-6d16-4303-a0fa-d0b3218bf983 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "POST /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 20.228855 Jun 26 03:13:50.688428 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 452/929] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:13:30 2022] POST /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments => generated 194 bytes in 20231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:13:51.247066 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-86678e0c-62d5-4781-bb5f-cf6c6cf7a694 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:51.247685 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-86678e0c-62d5-4781-bb5f-cf6c6cf7a694 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:51.253673 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86678e0c-62d5-4781-bb5f-cf6c6cf7a694 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:51.254428 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86678e0c-62d5-4781-bb5f-cf6c6cf7a694 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:51.255250 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86678e0c-62d5-4781-bb5f-cf6c6cf7a694 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:51.255698 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-86678e0c-62d5-4781-bb5f-cf6c6cf7a694 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:51.396677 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-86678e0c-62d5-4781-bb5f-cf6c6cf7a694 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:51.405500 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-86678e0c-62d5-4781-bb5f-cf6c6cf7a694 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:51.407043 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-86678e0c-62d5-4781-bb5f-cf6c6cf7a694 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:51.408200 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-86678e0c-62d5-4781-bb5f-cf6c6cf7a694 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.165619 Jun 26 03:13:51.408759 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 478/930] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:51 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:52.427402 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8083932d-3578-49d2-8dc1-0cc8c5de855c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:52.428097 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8083932d-3578-49d2-8dc1-0cc8c5de855c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:52.435523 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8083932d-3578-49d2-8dc1-0cc8c5de855c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:52.435976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8083932d-3578-49d2-8dc1-0cc8c5de855c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:52.436741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8083932d-3578-49d2-8dc1-0cc8c5de855c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:52.437184 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8083932d-3578-49d2-8dc1-0cc8c5de855c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:52.561214 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8083932d-3578-49d2-8dc1-0cc8c5de855c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:52.569072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8083932d-3578-49d2-8dc1-0cc8c5de855c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:52.570624 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8083932d-3578-49d2-8dc1-0cc8c5de855c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:52.572406 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8083932d-3578-49d2-8dc1-0cc8c5de855c tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.149287 Jun 26 03:13:52.572963 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 453/931] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:52 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:53.264166 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-4a75821c-c7a2-4c8d-8a3b-4179559c24f5 req-36e88514-5430-411e-8a94-b92b4db83047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee71e3f2-a415-4000-97d4-290a4675ee4e", "name": "network-vif-plugged", "status": "completed", "tag": "7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:53.273380 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-4a75821c-c7a2-4c8d-8a3b-4179559c24f5 req-36e88514-5430-411e-8a94-b92b4db83047 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:53.273871 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-4a75821c-c7a2-4c8d-8a3b-4179559c24f5 req-36e88514-5430-411e-8a94-b92b4db83047 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:53.286470 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-4a75821c-c7a2-4c8d-8a3b-4179559c24f5 req-36e88514-5430-411e-8a94-b92b4db83047 service nova] Creating event network-vif-plugged:7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6 for instance ee71e3f2-a415-4000-97d4-290a4675ee4e on hv-cinder-84684 Jun 26 03:13:53.292929 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-4a75821c-c7a2-4c8d-8a3b-4179559c24f5 req-36e88514-5430-411e-8a94-b92b4db83047 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032318 Jun 26 03:13:53.293684 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 479/932] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:13:53.590333 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-94e3c884-c5bf-4091-9c7a-4b37e657b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:53.591072 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-94e3c884-c5bf-4091-9c7a-4b37e657b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:53.597439 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94e3c884-c5bf-4091-9c7a-4b37e657b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:53.597890 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94e3c884-c5bf-4091-9c7a-4b37e657b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:53.598706 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94e3c884-c5bf-4091-9c7a-4b37e657b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:53.599146 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-94e3c884-c5bf-4091-9c7a-4b37e657b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:53.728684 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-94e3c884-c5bf-4091-9c7a-4b37e657b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:53.736408 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-94e3c884-c5bf-4091-9c7a-4b37e657b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:53.737889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-94e3c884-c5bf-4091-9c7a-4b37e657b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:53.739064 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-94e3c884-c5bf-4091-9c7a-4b37e657b518 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.153355 Jun 26 03:13:53.739638 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 454/933] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:53 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:54.758311 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-877440b7-0a2d-460d-8a40-ca611ceab2d4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:54.759002 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-877440b7-0a2d-460d-8a40-ca611ceab2d4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:54.765684 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-877440b7-0a2d-460d-8a40-ca611ceab2d4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:54.766165 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-877440b7-0a2d-460d-8a40-ca611ceab2d4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:54.766925 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-877440b7-0a2d-460d-8a40-ca611ceab2d4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:54.767363 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-877440b7-0a2d-460d-8a40-ca611ceab2d4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:54.897162 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-877440b7-0a2d-460d-8a40-ca611ceab2d4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:54.905557 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-877440b7-0a2d-460d-8a40-ca611ceab2d4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:54.907084 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-877440b7-0a2d-460d-8a40-ca611ceab2d4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:54.908235 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-877440b7-0a2d-460d-8a40-ca611ceab2d4 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1732 microversion: 2.20 time: 0.154551 Jun 26 03:13:54.908787 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 480/934] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:54 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:13:55.927303 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8769ef1a-6cb6-4c79-8ae9-f7552f24c8ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:55.927913 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8769ef1a-6cb6-4c79-8ae9-f7552f24c8ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:55.934992 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8769ef1a-6cb6-4c79-8ae9-f7552f24c8ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:55.935645 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8769ef1a-6cb6-4c79-8ae9-f7552f24c8ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:55.936417 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8769ef1a-6cb6-4c79-8ae9-f7552f24c8ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:55.936865 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8769ef1a-6cb6-4c79-8ae9-f7552f24c8ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:56.078564 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8769ef1a-6cb6-4c79-8ae9-f7552f24c8ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:56.086451 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8769ef1a-6cb6-4c79-8ae9-f7552f24c8ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:56.088499 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8769ef1a-6cb6-4c79-8ae9-f7552f24c8ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:13:56.089647 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8769ef1a-6cb6-4c79-8ae9-f7552f24c8ee tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1719 microversion: 2.20 time: 0.166306 Jun 26 03:13:56.090375 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 455/935] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:13:55 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:13:58.188254 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e58a2e43-e5d1-4f51-81d9-2f01eccc3d3c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:58.189202 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e58a2e43-e5d1-4f51-81d9-2f01eccc3d3c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:58.195698 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e58a2e43-e5d1-4f51-81d9-2f01eccc3d3c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:58.196159 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e58a2e43-e5d1-4f51-81d9-2f01eccc3d3c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:58.196969 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e58a2e43-e5d1-4f51-81d9-2f01eccc3d3c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:58.197419 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e58a2e43-e5d1-4f51-81d9-2f01eccc3d3c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:58.227547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e58a2e43-e5d1-4f51-81d9-2f01eccc3d3c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043115 Jun 26 03:13:58.238426 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a00bb118-25c6-467f-bd35-7f4c97de6469 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:13:58.238964 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a00bb118-25c6-467f-bd35-7f4c97de6469 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:58.245626 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a00bb118-25c6-467f-bd35-7f4c97de6469 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:58.246108 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a00bb118-25c6-467f-bd35-7f4c97de6469 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:58.246887 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a00bb118-25c6-467f-bd35-7f4c97de6469 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:58.247332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a00bb118-25c6-467f-bd35-7f4c97de6469 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:58.250118 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 481/936] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:13:58 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:13:58.278520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a00bb118-25c6-467f-bd35-7f4c97de6469 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments/a2defff8-42af-42cf-ba0c-2e4fcf43a724" status: 200 len: 194 microversion: 2.1 time: 0.043946 Jun 26 03:13:58.279430 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 456/937] 10.222.0.13 () {58 vars in 1412 bytes} [Sun Jun 26 03:13:58 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments/a2defff8-42af-42cf-ba0c-2e4fcf43a724 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:13:59.668035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-17ad5a71-cb6d-4c21-909f-01691e5f51c3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a577c99-f69f-4868-be23-3816d971c4c4"}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:13:59.670656 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-17ad5a71-cb6d-4c21-909f-01691e5f51c3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:13:59.678152 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17ad5a71-cb6d-4c21-909f-01691e5f51c3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:59.679225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17ad5a71-cb6d-4c21-909f-01691e5f51c3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:13:59.680016 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17ad5a71-cb6d-4c21-909f-01691e5f51c3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:13:59.680461 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17ad5a71-cb6d-4c21-909f-01691e5f51c3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:00.011705 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-17ad5a71-cb6d-4c21-909f-01691e5f51c3 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "POST /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348855 Jun 26 03:14:00.012318 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 482/938] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:13:59 2022] POST /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:07.725607 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f4094b7b-f8dc-4260-9d24-3084a07392ba tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:07.726920 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f4094b7b-f8dc-4260-9d24-3084a07392ba tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:07.736409 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f4094b7b-f8dc-4260-9d24-3084a07392ba tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:07.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f4094b7b-f8dc-4260-9d24-3084a07392ba tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:07.738181 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f4094b7b-f8dc-4260-9d24-3084a07392ba tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:07.738932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f4094b7b-f8dc-4260-9d24-3084a07392ba tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:07.782659 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f4094b7b-f8dc-4260-9d24-3084a07392ba tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.067527 Jun 26 03:14:07.783250 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 457/939] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:14:07 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:07.935137 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-aebf06d8-3c54-432c-89b1-da4922b9f1e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:07.936322 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-aebf06d8-3c54-432c-89b1-da4922b9f1e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:07.944237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-aebf06d8-3c54-432c-89b1-da4922b9f1e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:07.944702 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-aebf06d8-3c54-432c-89b1-da4922b9f1e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:07.945679 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-aebf06d8-3c54-432c-89b1-da4922b9f1e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:07.946149 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-aebf06d8-3c54-432c-89b1-da4922b9f1e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:07.981436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-aebf06d8-3c54-432c-89b1-da4922b9f1e8 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments/a2defff8-42af-42cf-ba0c-2e4fcf43a724" status: 200 len: 194 microversion: 2.1 time: 0.054151 Jun 26 03:14:07.982397 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 483/940] 10.222.0.13 () {58 vars in 1412 bytes} [Sun Jun 26 03:14:07 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments/a2defff8-42af-42cf-ba0c-2e4fcf43a724 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:07.992115 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-23cacf3a-4d13-4c07-b606-fd2dbd09bcc0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:07.992905 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-23cacf3a-4d13-4c07-b606-fd2dbd09bcc0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:08.000100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-23cacf3a-4d13-4c07-b606-fd2dbd09bcc0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:08.000815 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-23cacf3a-4d13-4c07-b606-fd2dbd09bcc0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:08.001696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-23cacf3a-4d13-4c07-b606-fd2dbd09bcc0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:08.002283 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-23cacf3a-4d13-4c07-b606-fd2dbd09bcc0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:08.093850 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-23cacf3a-4d13-4c07-b606-fd2dbd09bcc0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lazy-loading 'services' on Instance uuid 5a783f9a-6fb1-478a-8b64-b4ed9830b33f {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:14:08.177925 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-23cacf3a-4d13-4c07-b606-fd2dbd09bcc0 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments/a2defff8-42af-42cf-ba0c-2e4fcf43a724" status: 202 len: 0 microversion: 2.1 time: 0.189521 Jun 26 03:14:08.178563 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 458/941] 10.222.0.13 () {58 vars in 1415 bytes} [Sun Jun 26 03:14:07 2022] DELETE /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments/a2defff8-42af-42cf-ba0c-2e4fcf43a724 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:14:10.404268 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9008ced2-2da1-4bcb-835f-96aaf715783f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:10.404860 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9008ced2-2da1-4bcb-835f-96aaf715783f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:10.412340 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9008ced2-2da1-4bcb-835f-96aaf715783f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:10.412883 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9008ced2-2da1-4bcb-835f-96aaf715783f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:10.413664 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9008ced2-2da1-4bcb-835f-96aaf715783f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:10.414142 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9008ced2-2da1-4bcb-835f-96aaf715783f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:10.445244 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9008ced2-2da1-4bcb-835f-96aaf715783f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments/7a577c99-f69f-4868-be23-3816d971c4c4" status: 200 len: 194 microversion: 2.1 time: 0.044838 Jun 26 03:14:10.445851 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 484/942] 10.222.0.13 () {58 vars in 1412 bytes} [Sun Jun 26 03:14:10 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments/7a577c99-f69f-4868-be23-3816d971c4c4 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:10.457016 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-26c14ef6-940d-45a8-a486-da94bdce11ea tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:10.457727 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-26c14ef6-940d-45a8-a486-da94bdce11ea tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:10.464706 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-26c14ef6-940d-45a8-a486-da94bdce11ea tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:10.467749 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-26c14ef6-940d-45a8-a486-da94bdce11ea tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:10.468559 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-26c14ef6-940d-45a8-a486-da94bdce11ea tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:10.469180 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-26c14ef6-940d-45a8-a486-da94bdce11ea tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:10.560446 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-26c14ef6-940d-45a8-a486-da94bdce11ea tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lazy-loading 'services' on Instance uuid 5a783f9a-6fb1-478a-8b64-b4ed9830b33f {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:14:10.659118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-26c14ef6-940d-45a8-a486-da94bdce11ea tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments/7a577c99-f69f-4868-be23-3816d971c4c4" status: 202 len: 0 microversion: 2.1 time: 0.206573 Jun 26 03:14:10.660298 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 459/943] 10.222.0.13 () {58 vars in 1415 bytes} [Sun Jun 26 03:14:10 2022] DELETE /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments/7a577c99-f69f-4868-be23-3816d971c4c4 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 26 03:14:11.889007 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-433ab7f0-d629-43a3-b3b6-be428709b32f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:11.889938 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-433ab7f0-d629-43a3-b3b6-be428709b32f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:11.897021 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-433ab7f0-d629-43a3-b3b6-be428709b32f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:11.897522 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-433ab7f0-d629-43a3-b3b6-be428709b32f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:11.898343 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-433ab7f0-d629-43a3-b3b6-be428709b32f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:11.898863 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-433ab7f0-d629-43a3-b3b6-be428709b32f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:11.926238 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:11.931196 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-433ab7f0-d629-43a3-b3b6-be428709b32f tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045629 Jun 26 03:14:11.932019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 485/944] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:14:11 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 26 03:14:12.071863 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3a33780a-7542-40ed-96f5-005f8ecb15c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:12.072925 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3a33780a-7542-40ed-96f5-005f8ecb15c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:12.079439 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3a33780a-7542-40ed-96f5-005f8ecb15c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:12.079891 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3a33780a-7542-40ed-96f5-005f8ecb15c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:12.080853 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3a33780a-7542-40ed-96f5-005f8ecb15c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:12.081523 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3a33780a-7542-40ed-96f5-005f8ecb15c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:12.119071 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3a33780a-7542-40ed-96f5-005f8ecb15c7 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052025 Jun 26 03:14:12.119633 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 460/945] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:14:12 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 26 03:14:12.191175 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-94c57fd9-e1c8-4216-9e8f-af2a637a0a91 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:12.192319 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-94c57fd9-e1c8-4216-9e8f-af2a637a0a91 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:12.203975 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-94c57fd9-e1c8-4216-9e8f-af2a637a0a91 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:12.204446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-94c57fd9-e1c8-4216-9e8f-af2a637a0a91 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:12.205294 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-94c57fd9-e1c8-4216-9e8f-af2a637a0a91 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:12.205742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-94c57fd9-e1c8-4216-9e8f-af2a637a0a91 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:12.235755 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-94c57fd9-e1c8-4216-9e8f-af2a637a0a91 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:14:12.323511 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-94c57fd9-e1c8-4216-9e8f-af2a637a0a91 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 204 len: 0 microversion: 2.1 time: 0.136063 Jun 26 03:14:12.324335 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 486/946] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:14:12 2022] DELETE /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:14:12.333158 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7f3772ed-e77d-4a6e-b9af-3f1c7fb0ed3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:12.333962 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7f3772ed-e77d-4a6e-b9af-3f1c7fb0ed3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:12.340549 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7f3772ed-e77d-4a6e-b9af-3f1c7fb0ed3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:12.341084 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7f3772ed-e77d-4a6e-b9af-3f1c7fb0ed3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:12.342085 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7f3772ed-e77d-4a6e-b9af-3f1c7fb0ed3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:12.342827 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7f3772ed-e77d-4a6e-b9af-3f1c7fb0ed3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:12.486275 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7f3772ed-e77d-4a6e-b9af-3f1c7fb0ed3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:12.495155 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-7f3772ed-e77d-4a6e-b9af-3f1c7fb0ed3b tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1674 microversion: 2.1 time: 0.165879 Jun 26 03:14:12.496028 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 461/947] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:12 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:13.514124 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6006b69e-2451-44b2-b5f3-d44e57f95a99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:13.514950 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-6006b69e-2451-44b2-b5f3-d44e57f95a99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:13.521501 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6006b69e-2451-44b2-b5f3-d44e57f95a99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:13.522033 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6006b69e-2451-44b2-b5f3-d44e57f95a99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:13.523120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6006b69e-2451-44b2-b5f3-d44e57f95a99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:13.523730 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6006b69e-2451-44b2-b5f3-d44e57f95a99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:13.665935 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6006b69e-2451-44b2-b5f3-d44e57f95a99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:13.675864 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6006b69e-2451-44b2-b5f3-d44e57f95a99 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1674 microversion: 2.1 time: 0.166649 Jun 26 03:14:13.687751 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 487/948] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:13 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:14.537739 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-09446dc9-8eb9-449a-a4bc-b3220b605462 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Action: 'create', calling method: .version_select at 0x7f58276974c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1102567893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGFtjOc1dhC0Fv+5FwnpbGgS5dQg5MyRDRVTQ2xHDU8aGxMqgCr6a4TnRxZg8g4LHIapkhs11SQxnqri0qwV6dBReO9pDDP+L74OzPVq0eIrwEFYpD8+UJQ/WQ0nslKbg=="}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:14.551616 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-09446dc9-8eb9-449a-a4bc-b3220b605462 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Getting quotas for project 1fe0cd601688420d88ea051894cfdf2a. Resources: {'key_pairs'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:14:14.555353 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-09446dc9-8eb9-449a-a4bc-b3220b605462 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Getting quotas for user 1042fb5384e14cd2bc7090f09db977c2 and project 1fe0cd601688420d88ea051894cfdf2a. Resources: {'key_pairs'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:14:14.576483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-09446dc9-8eb9-449a-a4bc-b3220b605462 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.042526 Jun 26 03:14:14.577051 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 462/949] 10.222.0.13 () {60 vars in 1158 bytes} [Sun Jun 26 03:14:14 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:14.625243 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-828398654", "imageRef": "6595c671-acb0-498a-95cd-e674bf8f44d3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1102567893", "networks": [{"uuid": "3de8e86e-4cff-434c-bc8d-f0cd4e8a3cd2"}]}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:14.632603 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:14.679491 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] validate_networks() for [('3de8e86e-4cff-434c-bc8d-f0cd4e8a3cd2', None, None, None, None, None)] {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:14:14.693296 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8412441b-852c-407d-bdd2-f499dace8c97 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:14.694032 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8412441b-852c-407d-bdd2-f499dace8c97 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:14.700779 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8412441b-852c-407d-bdd2-f499dace8c97 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:14.701252 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8412441b-852c-407d-bdd2-f499dace8c97 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:14.702141 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8412441b-852c-407d-bdd2-f499dace8c97 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:14.702653 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8412441b-852c-407d-bdd2-f499dace8c97 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:14.991631 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8412441b-852c-407d-bdd2-f499dace8c97 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:14.999811 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8412441b-852c-407d-bdd2-f499dace8c97 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1674 microversion: 2.1 time: 0.310405 Jun 26 03:14:15.000383 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 463/950] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:14 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1674 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:14:15.434456 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:14:15.434887 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:14:15.435519 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:14:15.436146 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:14:15.436776 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:14:15.450619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:15.451294 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:15.452672 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:15.453336 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:15.478568 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Getting quotas for project 1fe0cd601688420d88ea051894cfdf2a. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:14:15.483511 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Getting quotas for user 1042fb5384e14cd2bc7090f09db977c2 and project 1fe0cd601688420d88ea051894cfdf2a. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:14:15.495592 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:14:15.498617 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6595c671-acb0-498a-95cd-e674bf8f44d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:14:15.548990 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-267d53c6-dd78-43b7-a182-73a3da541249 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927678 Jun 26 03:14:15.549939 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 488/951] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:14:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:14:15.560274 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ad951c09-d515-4de6-acdd-05dfaa0ac216 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:15.561805 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ad951c09-d515-4de6-acdd-05dfaa0ac216 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:15.628736 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ad951c09-d515-4de6-acdd-05dfaa0ac216 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:15.638269 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ad951c09-d515-4de6-acdd-05dfaa0ac216 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1258 microversion: 2.1 time: 0.082611 Jun 26 03:14:15.638918 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 464/952] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:15 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1258 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:15.849177 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-3130adec-fb02-4965-b61c-6a46469520fa req-0b3d87e0-5c79-4575-9bdb-da09ce9ae057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a783f9a-6fb1-478a-8b64-b4ed9830b33f", "name": "network-vif-deleted", "tag": "98cb08d8-ef21-4ac4-a52f-3d665ef4ed53"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:15.859591 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-3130adec-fb02-4965-b61c-6a46469520fa req-0b3d87e0-5c79-4575-9bdb-da09ce9ae057 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:15.860107 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-3130adec-fb02-4965-b61c-6a46469520fa req-0b3d87e0-5c79-4575-9bdb-da09ce9ae057 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:15.888303 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-3130adec-fb02-4965-b61c-6a46469520fa req-0b3d87e0-5c79-4575-9bdb-da09ce9ae057 service nova] Creating event network-vif-deleted:98cb08d8-ef21-4ac4-a52f-3d665ef4ed53 for instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f on hv-cinder-84684 Jun 26 03:14:15.903478 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-3130adec-fb02-4965-b61c-6a46469520fa req-0b3d87e0-5c79-4575-9bdb-da09ce9ae057 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058376 Jun 26 03:14:15.904335 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 489/953] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:16.021053 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-653de093-b480-459f-8ef6-003321920bcd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:16.027552 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-653de093-b480-459f-8ef6-003321920bcd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:16.043079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-653de093-b480-459f-8ef6-003321920bcd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:16.043458 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-653de093-b480-459f-8ef6-003321920bcd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:16.044252 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-653de093-b480-459f-8ef6-003321920bcd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:16.044697 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-653de093-b480-459f-8ef6-003321920bcd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:16.085057 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-653de093-b480-459f-8ef6-003321920bcd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:16.085515 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-653de093-b480-459f-8ef6-003321920bcd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:16.085976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-653de093-b480-459f-8ef6-003321920bcd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lazy-loading 'fault' on Instance uuid 5a783f9a-6fb1-478a-8b64-b4ed9830b33f {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:14:16.134341 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-653de093-b480-459f-8ef6-003321920bcd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95793ccb15844069890363d983f1680d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86edd65ecb4972ba8bb33b34387432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:16.142102 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-653de093-b480-459f-8ef6-003321920bcd tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 200 len: 1328 microversion: 2.1 time: 0.124869 Jun 26 03:14:16.142671 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 465/954] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:16 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 1328 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:16.655997 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-26ab1baf-1bde-42ee-b5cf-1fbb6939b831 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:16.656740 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-26ab1baf-1bde-42ee-b5cf-1fbb6939b831 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:16.663213 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-26ab1baf-1bde-42ee-b5cf-1fbb6939b831 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:16.663669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-26ab1baf-1bde-42ee-b5cf-1fbb6939b831 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:16.664437 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-26ab1baf-1bde-42ee-b5cf-1fbb6939b831 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:16.664872 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-26ab1baf-1bde-42ee-b5cf-1fbb6939b831 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:16.731016 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-26ab1baf-1bde-42ee-b5cf-1fbb6939b831 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:16.738910 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-26ab1baf-1bde-42ee-b5cf-1fbb6939b831 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1310 microversion: 2.1 time: 0.087185 Jun 26 03:14:16.739497 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 490/955] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:16 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:17.160481 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a30509e0-4334-4352-92c6-4537ec0c0a87 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:17.161129 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a30509e0-4334-4352-92c6-4537ec0c0a87 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:17.169047 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a30509e0-4334-4352-92c6-4537ec0c0a87 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:17.169598 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a30509e0-4334-4352-92c6-4537ec0c0a87 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:17.170820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a30509e0-4334-4352-92c6-4537ec0c0a87 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:17.171372 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a30509e0-4334-4352-92c6-4537ec0c0a87 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:17.188310 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-a30509e0-4334-4352-92c6-4537ec0c0a87 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] HTTP exception thrown: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a30509e0-4334-4352-92c6-4537ec0c0a87 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Request method failure captured: Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f HTTP/1.1 Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zOFbTovpqGhW0szkPta9b7uIMmMog_KiOJEvaQFjSoDidiLUL0aQ6VkpUL7F_BJNMiTm4CoTWRso7rpu262e18AfKVcnmu1MYHMNKU5rgQ2DPXJ1yMUjaCvmjrfPf-CDZ3vpadspHUHH9rssEdURNKRCveNXKcolRqPs0z4_JxeGo Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: ea86edd65ecb4972ba8bb33b34387432 Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:14:17.190173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:14:17.191840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea86edd65ecb4972ba8bb33b34387432"}]}] Jun 26 03:14:17.191840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:17.191840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: ea86edd65ecb4972ba8bb33b34387432 Jun 26 03:14:17.191840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:17.191840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeTestJSON-26732284-project Jun 26 03:14:17.191840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:14:17.191840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:14:17.191840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 95793ccb15844069890363d983f1680d Jun 26 03:14:17.191840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeTestJSON-26732284-project Jun 26 03:14:17.191840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:14:17.191840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:17.191840 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '5a783f9a-6fb1-478a-8b64-b4ed9830b33f'} Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:17.192938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:17.194601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:17.195982 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a30509e0-4334-4352-92c6-4537ec0c0a87 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Returning 404 to user: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:17.195982 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a30509e0-4334-4352-92c6-4537ec0c0a87 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 404 len: 111 microversion: 2.1 time: 0.038042 Jun 26 03:14:17.196405 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 466/956] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:17 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:14:17.205172 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-706bd8a3-df4b-460a-983e-5960122940a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '.version_select at 0x7f582779eca0>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:17.208687 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR oslo.messaging._drivers.impl_rabbit [None req-706bd8a3-df4b-460a-983e-5960122940a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [c0400173-c90d-4b9f-8ea1-831f8df2c05d] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 26 03:14:17.756910 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5340cbbd-541e-402b-adec-db2865592fbf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:17.757933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5340cbbd-541e-402b-adec-db2865592fbf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:17.765336 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5340cbbd-541e-402b-adec-db2865592fbf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:17.766470 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5340cbbd-541e-402b-adec-db2865592fbf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:17.767479 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5340cbbd-541e-402b-adec-db2865592fbf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:17.768116 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5340cbbd-541e-402b-adec-db2865592fbf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:17.913960 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5340cbbd-541e-402b-adec-db2865592fbf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:17.921683 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5340cbbd-541e-402b-adec-db2865592fbf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.168847 Jun 26 03:14:17.922224 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 467/957] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:17 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:18.219050 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO oslo.messaging._drivers.impl_rabbit [None req-706bd8a3-df4b-460a-983e-5960122940a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [c0400173-c90d-4b9f-8ea1-831f8df2c05d] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 57202. Jun 26 03:14:18.244315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-706bd8a3-df4b-460a-983e-5960122940a6 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947287630" status: 202 len: 0 microversion: 2.1 time: 1.042871 Jun 26 03:14:18.245029 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 491/958] 10.222.0.13 () {58 vars in 1220 bytes} [Sun Jun 26 03:14:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947287630 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:14:18.943055 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-17184bee-64ad-4b2c-ae10-7c6f6a98f3bd tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:18.944596 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-17184bee-64ad-4b2c-ae10-7c6f6a98f3bd tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:18.953590 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-17184bee-64ad-4b2c-ae10-7c6f6a98f3bd tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:18.954052 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-17184bee-64ad-4b2c-ae10-7c6f6a98f3bd tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:18.955093 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-17184bee-64ad-4b2c-ae10-7c6f6a98f3bd tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:18.955704 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-17184bee-64ad-4b2c-ae10-7c6f6a98f3bd tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:19.106154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-17184bee-64ad-4b2c-ae10-7c6f6a98f3bd tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:19.114023 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-17184bee-64ad-4b2c-ae10-7c6f6a98f3bd tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.178132 Jun 26 03:14:19.114624 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 468/959] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:18 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:20.131121 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3a488b77-dd2f-4af6-bc77-e8425f8e6e95 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:20.131943 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3a488b77-dd2f-4af6-bc77-e8425f8e6e95 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:20.140838 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a488b77-dd2f-4af6-bc77-e8425f8e6e95 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:20.141433 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a488b77-dd2f-4af6-bc77-e8425f8e6e95 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:20.142358 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a488b77-dd2f-4af6-bc77-e8425f8e6e95 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:20.142870 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3a488b77-dd2f-4af6-bc77-e8425f8e6e95 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:20.282159 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3a488b77-dd2f-4af6-bc77-e8425f8e6e95 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:20.289556 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3a488b77-dd2f-4af6-bc77-e8425f8e6e95 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.162929 Jun 26 03:14:20.290141 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 492/960] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:20 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:21.207787 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-cfdcdcc8-cf7f-4204-8cf7-ee13adc9aeb1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:21.208284 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-cfdcdcc8-cf7f-4204-8cf7-ee13adc9aeb1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:21.210729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:21.217449 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cfdcdcc8-cf7f-4204-8cf7-ee13adc9aeb1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:21.218020 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cfdcdcc8-cf7f-4204-8cf7-ee13adc9aeb1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:21.218824 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cfdcdcc8-cf7f-4204-8cf7-ee13adc9aeb1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:21.219260 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cfdcdcc8-cf7f-4204-8cf7-ee13adc9aeb1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:21.222600 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:21.236372 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-cfdcdcc8-cf7f-4204-8cf7-ee13adc9aeb1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] HTTP exception thrown: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-cfdcdcc8-cf7f-4204-8cf7-ee13adc9aeb1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Request method failure captured: Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: DELETE /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f HTTP/1.1 Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zOFbTovpqGhW0szkPta9b7uIMmMog_KiOJEvaQFjSoDidiLUL0aQ6VkpUL7F_BJNMiTm4CoTWRso7rpu262e18AfKVcnmu1MYHMNKU5rgQ2DPXJ1yMUjaCvmjrfPf-CDZ3vpadspHUHH9rssEdURNKRCveNXKcolRqPs0z4_JxeGo Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: ea86edd65ecb4972ba8bb33b34387432 Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:14:21.238440 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:14:21.240100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea86edd65ecb4972ba8bb33b34387432"}]}] Jun 26 03:14:21.240100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:21.240100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: ea86edd65ecb4972ba8bb33b34387432 Jun 26 03:14:21.240100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:21.240100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeTestJSON-26732284-project Jun 26 03:14:21.240100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:14:21.240100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:14:21.240100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 95793ccb15844069890363d983f1680d Jun 26 03:14:21.240100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeTestJSON-26732284-project Jun 26 03:14:21.240100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:14:21.240100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:21.240100 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '5a783f9a-6fb1-478a-8b64-b4ed9830b33f'} Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:21.240957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:21.242218 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:21.243473 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-cfdcdcc8-cf7f-4204-8cf7-ee13adc9aeb1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Returning 404 to user: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:21.243473 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-cfdcdcc8-cf7f-4204-8cf7-ee13adc9aeb1 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 404 len: 111 microversion: 2.1 time: 0.035945 Jun 26 03:14:21.243473 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 469/961] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:14:21 2022] DELETE /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:14:21.248354 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d71ab3e9-7bd4-4dc4-b70a-d7fb2ba1c44c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:21.248964 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d71ab3e9-7bd4-4dc4-b70a-d7fb2ba1c44c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 5a783f9a-6fb1-478a-8b64-b4ed9830b33f] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:21.256094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d71ab3e9-7bd4-4dc4-b70a-d7fb2ba1c44c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:21.256756 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d71ab3e9-7bd4-4dc4-b70a-d7fb2ba1c44c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:21.257532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d71ab3e9-7bd4-4dc4-b70a-d7fb2ba1c44c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:21.257971 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d71ab3e9-7bd4-4dc4-b70a-d7fb2ba1c44c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:21.271976 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-d71ab3e9-7bd4-4dc4-b70a-d7fb2ba1c44c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] HTTP exception thrown: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d71ab3e9-7bd4-4dc4-b70a-d7fb2ba1c44c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Request method failure captured: Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f HTTP/1.1 Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zOFbTovpqGhW0szkPta9b7uIMmMog_KiOJEvaQFjSoDidiLUL0aQ6VkpUL7F_BJNMiTm4CoTWRso7rpu262e18AfKVcnmu1MYHMNKU5rgQ2DPXJ1yMUjaCvmjrfPf-CDZ3vpadspHUHH9rssEdURNKRCveNXKcolRqPs0z4_JxeGo Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: ea86edd65ecb4972ba8bb33b34387432 Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:14:21.273628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:14:21.275761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea86edd65ecb4972ba8bb33b34387432"}]}] Jun 26 03:14:21.275761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:21.275761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: ea86edd65ecb4972ba8bb33b34387432 Jun 26 03:14:21.275761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:21.275761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-AttachVolumeTestJSON-26732284-project Jun 26 03:14:21.275761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:14:21.275761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:14:21.275761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 95793ccb15844069890363d983f1680d Jun 26 03:14:21.275761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-AttachVolumeTestJSON-26732284-project Jun 26 03:14:21.275761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:14:21.275761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:21.275761 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '5a783f9a-6fb1-478a-8b64-b4ed9830b33f'} Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:21.277094 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. Jun 26 03:14:21.278801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:21.280377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d71ab3e9-7bd4-4dc4-b70a-d7fb2ba1c44c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Returning 404 to user: Instance 5a783f9a-6fb1-478a-8b64-b4ed9830b33f could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:21.280377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d71ab3e9-7bd4-4dc4-b70a-d7fb2ba1c44c tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f" status: 404 len: 111 microversion: 2.1 time: 0.030461 Jun 26 03:14:21.280377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 493/962] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:21 2022] GET /compute/v2.1/servers/5a783f9a-6fb1-478a-8b64-b4ed9830b33f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:14:21.306484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4e0758af-98ff-482d-8d9d-f81c48ec09c6 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:21.307484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4e0758af-98ff-482d-8d9d-f81c48ec09c6 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:21.314348 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4e0758af-98ff-482d-8d9d-f81c48ec09c6 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:21.314793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4e0758af-98ff-482d-8d9d-f81c48ec09c6 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:21.315751 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4e0758af-98ff-482d-8d9d-f81c48ec09c6 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:21.316267 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4e0758af-98ff-482d-8d9d-f81c48ec09c6 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:21.479774 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4e0758af-98ff-482d-8d9d-f81c48ec09c6 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:21.487105 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4e0758af-98ff-482d-8d9d-f81c48ec09c6 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.184831 Jun 26 03:14:21.487656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 470/963] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:21 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:22.425286 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-05facc26-24eb-4b5f-a6c6-549e1ed1ab89 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:22.425800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-05facc26-24eb-4b5f-a6c6-549e1ed1ab89 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:22.432927 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-05facc26-24eb-4b5f-a6c6-549e1ed1ab89 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:22.433383 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-05facc26-24eb-4b5f-a6c6-549e1ed1ab89 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:22.434261 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-05facc26-24eb-4b5f-a6c6-549e1ed1ab89 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:22.434705 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-05facc26-24eb-4b5f-a6c6-549e1ed1ab89 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:22.449233 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-05facc26-24eb-4b5f-a6c6-549e1ed1ab89 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] HTTP exception thrown: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-05facc26-24eb-4b5f-a6c6-549e1ed1ab89 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Request method failure captured: Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: DELETE /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d HTTP/1.1 Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zOFbTovpqGhW0szkPta9b7uIMmMog_KiOJEvaQFjSoDidiLUL0aQ6VkpUL7F_BJNMiTm4CoTWRso7rpu262e18AfKVcnmu1MYHMNKU5rgQ2DPXJ1yMUjaCvmjrfPf-CDZ3vpadspHUHH9rssEdURNKRCveNXKcolRqPs0z4_JxeGo Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: ea86edd65ecb4972ba8bb33b34387432 Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:14:22.450822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:14:22.452298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea86edd65ecb4972ba8bb33b34387432"}]}] Jun 26 03:14:22.452298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:22.452298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: ea86edd65ecb4972ba8bb33b34387432 Jun 26 03:14:22.452298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:22.452298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-AttachVolumeTestJSON-26732284-project Jun 26 03:14:22.452298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:14:22.452298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:14:22.452298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 95793ccb15844069890363d983f1680d Jun 26 03:14:22.452298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-AttachVolumeTestJSON-26732284-project Jun 26 03:14:22.452298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:14:22.452298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:14:22.452298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '1c55ca6d-bad0-4964-83fe-4352b7fb1b1d'} Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:22.453055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:14:22.454430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:22.455760 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-05facc26-24eb-4b5f-a6c6-549e1ed1ab89 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Returning 404 to user: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:22.455760 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-05facc26-24eb-4b5f-a6c6-549e1ed1ab89 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 404 len: 111 microversion: 2.1 time: 0.030738 Jun 26 03:14:22.455760 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 494/964] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:14:22 2022] DELETE /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:14:22.461337 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-32218c49-b923-4d92-8f4e-ab2f6191f904 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:22.462008 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-32218c49-b923-4d92-8f4e-ab2f6191f904 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] [instance: 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:22.469214 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-32218c49-b923-4d92-8f4e-ab2f6191f904 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:22.469670 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-32218c49-b923-4d92-8f4e-ab2f6191f904 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:22.470468 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-32218c49-b923-4d92-8f4e-ab2f6191f904 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:22.470909 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-32218c49-b923-4d92-8f4e-ab2f6191f904 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:22.485112 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-32218c49-b923-4d92-8f4e-ab2f6191f904 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] HTTP exception thrown: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-32218c49-b923-4d92-8f4e-ab2f6191f904 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Request method failure captured: Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d HTTP/1.1 Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zOFbTovpqGhW0szkPta9b7uIMmMog_KiOJEvaQFjSoDidiLUL0aQ6VkpUL7F_BJNMiTm4CoTWRso7rpu262e18AfKVcnmu1MYHMNKU5rgQ2DPXJ1yMUjaCvmjrfPf-CDZ3vpadspHUHH9rssEdURNKRCveNXKcolRqPs0z4_JxeGo Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: ea86edd65ecb4972ba8bb33b34387432 Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:14:22.487168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:14:22.488747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea86edd65ecb4972ba8bb33b34387432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea86edd65ecb4972ba8bb33b34387432"}]}] Jun 26 03:14:22.488747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:22.488747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: ea86edd65ecb4972ba8bb33b34387432 Jun 26 03:14:22.488747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeTestJSON-26732284 Jun 26 03:14:22.488747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeTestJSON-26732284-project Jun 26 03:14:22.488747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:14:22.488747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:14:22.488747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 95793ccb15844069890363d983f1680d Jun 26 03:14:22.488747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeTestJSON-26732284-project Jun 26 03:14:22.488747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:14:22.488747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:14:22.488747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '1c55ca6d-bad0-4964-83fe-4352b7fb1b1d'} Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:22.489613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. Jun 26 03:14:22.490988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:22.492049 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-32218c49-b923-4d92-8f4e-ab2f6191f904 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] Returning 404 to user: Instance 1c55ca6d-bad0-4964-83fe-4352b7fb1b1d could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:22.492049 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-32218c49-b923-4d92-8f4e-ab2f6191f904 tempest-AttachVolumeTestJSON-26732284 tempest-AttachVolumeTestJSON-26732284-project] 10.222.0.13 "GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d" status: 404 len: 111 microversion: 2.1 time: 0.034284 Jun 26 03:14:22.492538 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 471/965] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:22 2022] GET /compute/v2.1/servers/1c55ca6d-bad0-4964-83fe-4352b7fb1b1d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:14:22.507634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c841a627-89d6-4457-9a81-e123640277e2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:22.508328 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c841a627-89d6-4457-9a81-e123640277e2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:22.514985 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c841a627-89d6-4457-9a81-e123640277e2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:22.515434 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c841a627-89d6-4457-9a81-e123640277e2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:22.516203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c841a627-89d6-4457-9a81-e123640277e2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:22.516669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c841a627-89d6-4457-9a81-e123640277e2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:22.660470 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c841a627-89d6-4457-9a81-e123640277e2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:22.668039 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c841a627-89d6-4457-9a81-e123640277e2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.167583 Jun 26 03:14:22.668615 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 495/966] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:22 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:23.685002 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fcf8c871-d016-4291-967f-0ece9273de23 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:23.686932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-fcf8c871-d016-4291-967f-0ece9273de23 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:23.695041 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fcf8c871-d016-4291-967f-0ece9273de23 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:23.695852 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fcf8c871-d016-4291-967f-0ece9273de23 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:23.697439 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fcf8c871-d016-4291-967f-0ece9273de23 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:23.698176 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fcf8c871-d016-4291-967f-0ece9273de23 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:23.849865 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-fcf8c871-d016-4291-967f-0ece9273de23 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:23.859143 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-fcf8c871-d016-4291-967f-0ece9273de23 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.178151 Jun 26 03:14:23.859719 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 472/967] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:23 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:24.877172 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ae54b4b2-d549-41c9-bbe6-3f1176cf2e50 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:24.877661 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ae54b4b2-d549-41c9-bbe6-3f1176cf2e50 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:24.884164 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ae54b4b2-d549-41c9-bbe6-3f1176cf2e50 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:24.884619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ae54b4b2-d549-41c9-bbe6-3f1176cf2e50 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:24.885393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ae54b4b2-d549-41c9-bbe6-3f1176cf2e50 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:24.885872 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ae54b4b2-d549-41c9-bbe6-3f1176cf2e50 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:25.049944 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ae54b4b2-d549-41c9-bbe6-3f1176cf2e50 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:25.060924 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ae54b4b2-d549-41c9-bbe6-3f1176cf2e50 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.187732 Jun 26 03:14:25.061742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 496/968] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:24 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:26.077884 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-46cc3a55-2efc-4516-bb09-053e6282a2c9 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:26.079403 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-46cc3a55-2efc-4516-bb09-053e6282a2c9 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:26.094892 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=6 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:26.100748 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-46cc3a55-2efc-4516-bb09-053e6282a2c9 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:26.101211 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-46cc3a55-2efc-4516-bb09-053e6282a2c9 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:26.102004 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-46cc3a55-2efc-4516-bb09-053e6282a2c9 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:26.102485 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-46cc3a55-2efc-4516-bb09-053e6282a2c9 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:26.292322 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-46cc3a55-2efc-4516-bb09-053e6282a2c9 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:26.301139 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-46cc3a55-2efc-4516-bb09-053e6282a2c9 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.227159 Jun 26 03:14:26.306498 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 473/969] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:26 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:27.318189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-38318448-5f6e-4529-8a66-68d7adddb58e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:27.319462 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-38318448-5f6e-4529-8a66-68d7adddb58e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:27.326508 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=2 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:27.327295 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=6 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:27.330196 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-38318448-5f6e-4529-8a66-68d7adddb58e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:27.330852 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-38318448-5f6e-4529-8a66-68d7adddb58e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:27.331614 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-38318448-5f6e-4529-8a66-68d7adddb58e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:27.332242 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-38318448-5f6e-4529-8a66-68d7adddb58e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:27.459700 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-6d41ac14-3ff2-4bd3-87c0-9332d9918e41 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Action: 'create', calling method: .version_select at 0x7f582c2cce50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1390876643"}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:27.476965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-38318448-5f6e-4529-8a66-68d7adddb58e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:27.484590 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-38318448-5f6e-4529-8a66-68d7adddb58e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.170347 Jun 26 03:14:27.485237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 497/970] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:27 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:27.751078 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-6d41ac14-3ff2-4bd3-87c0-9332d9918e41 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.407389 Jun 26 03:14:27.751745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 474/971] 10.222.0.13 () {60 vars in 1154 bytes} [Sun Jun 26 03:14:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 409 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 26 03:14:27.763454 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b838329d-9ab5-4898-8639-e699a7c48056 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f582779e670>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:27.811605 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b838329d-9ab5-4898-8639-e699a7c48056 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd" status: 200 len: 345 microversion: 2.1 time: 0.052502 Jun 26 03:14:27.812244 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 498/972] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:14:27 2022] GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:28.501747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5547481c-e5de-41fd-b6f2-91525046df19 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:28.502380 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5547481c-e5de-41fd-b6f2-91525046df19 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:28.509540 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5547481c-e5de-41fd-b6f2-91525046df19 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:28.509989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5547481c-e5de-41fd-b6f2-91525046df19 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:28.510773 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5547481c-e5de-41fd-b6f2-91525046df19 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:28.511210 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5547481c-e5de-41fd-b6f2-91525046df19 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:28.637914 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5547481c-e5de-41fd-b6f2-91525046df19 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:28.645419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5547481c-e5de-41fd-b6f2-91525046df19 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.148106 Jun 26 03:14:28.645970 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 475/973] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:28 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:28.824979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3670996a-c65f-4d97-8885-bc8d72ab3482 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f58276a6790>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:28.872712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3670996a-c65f-4d97-8885-bc8d72ab3482 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd" status: 200 len: 345 microversion: 2.1 time: 0.052498 Jun 26 03:14:28.873302 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 499/974] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:14:28 2022] GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:29.662385 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-64e74ac9-f734-4a44-8e50-474c876a9ca2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:29.662993 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-64e74ac9-f734-4a44-8e50-474c876a9ca2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:29.669912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-64e74ac9-f734-4a44-8e50-474c876a9ca2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:29.670401 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-64e74ac9-f734-4a44-8e50-474c876a9ca2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:29.671155 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-64e74ac9-f734-4a44-8e50-474c876a9ca2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:29.671590 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-64e74ac9-f734-4a44-8e50-474c876a9ca2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:29.796284 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-64e74ac9-f734-4a44-8e50-474c876a9ca2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:29.803602 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-64e74ac9-f734-4a44-8e50-474c876a9ca2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.145146 Jun 26 03:14:29.804170 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 476/975] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:29 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:29.885249 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b89db19b-d3d6-4dcb-b104-d1e1cacf79cd tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f5827752550>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:29.932236 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b89db19b-d3d6-4dcb-b104-d1e1cacf79cd tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd" status: 200 len: 346 microversion: 2.1 time: 0.051209 Jun 26 03:14:29.932788 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 500/976] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:14:29 2022] GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:29.943599 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-49df0ece-9299-4850-96ca-2e5a76ca27fc tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Action: 'create', calling method: .version_select at 0x7f58275df700>, body: {"snapshot": {"volume_id": "7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-978531847"}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:30.085173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-49df0ece-9299-4850-96ca-2e5a76ca27fc tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.145314 Jun 26 03:14:30.085758 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 477/977] 10.222.0.13 () {60 vars in 1161 bytes} [Sun Jun 26 03:14:29 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:30.096396 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-23defa10-dc0f-40c1-84e7-b2f63074bf5b tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f58276a6790>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:30.126581 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-23defa10-dc0f-40c1-84e7-b2f63074bf5b tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b" status: 200 len: 286 microversion: 2.1 time: 0.033919 Jun 26 03:14:30.127185 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 501/978] 10.222.0.13 () {58 vars in 1250 bytes} [Sun Jun 26 03:14:30 2022] GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:14:30.137267 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-484b7ff4-8236-4bde-a1dd-c5f26c490258 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f58276eb280>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:30.166395 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-484b7ff4-8236-4bde-a1dd-c5f26c490258 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032808 Jun 26 03:14:30.166905 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 478/979] 10.222.0.13 () {58 vars in 1139 bytes} [Sun Jun 26 03:14:30 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:30.176861 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-722ea7a5-7b0a-4ad8-9618-1ba570138119 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f5827587a60>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:30.206692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-722ea7a5-7b0a-4ad8-9618-1ba570138119 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b" status: 200 len: 286 microversion: 2.1 time: 0.033528 Jun 26 03:14:30.207258 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 502/980] 10.222.0.13 () {58 vars in 1250 bytes} [Sun Jun 26 03:14:30 2022] GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:30.821165 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-aa960b3f-752d-4778-80b2-1115913908b7 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:30.821806 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-aa960b3f-752d-4778-80b2-1115913908b7 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:30.828414 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aa960b3f-752d-4778-80b2-1115913908b7 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:30.828872 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aa960b3f-752d-4778-80b2-1115913908b7 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:30.829640 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aa960b3f-752d-4778-80b2-1115913908b7 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:30.830108 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-aa960b3f-752d-4778-80b2-1115913908b7 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:30.958853 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-aa960b3f-752d-4778-80b2-1115913908b7 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:30.966733 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-aa960b3f-752d-4778-80b2-1115913908b7 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.149938 Jun 26 03:14:30.967291 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 479/981] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:30 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:31.218803 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e074c148-ed27-4649-b80e-27f2d0112a4c tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f582779e430>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:31.247455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e074c148-ed27-4649-b80e-27f2d0112a4c tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b" status: 200 len: 286 microversion: 2.1 time: 0.032948 Jun 26 03:14:31.248056 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 503/982] 10.222.0.13 () {58 vars in 1250 bytes} [Sun Jun 26 03:14:31 2022] GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:31.984580 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-31d013c8-b666-4309-87ef-30f13419599d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:31.985195 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-31d013c8-b666-4309-87ef-30f13419599d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:31.991692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31d013c8-b666-4309-87ef-30f13419599d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:31.992144 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31d013c8-b666-4309-87ef-30f13419599d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:31.992907 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31d013c8-b666-4309-87ef-30f13419599d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:31.993948 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31d013c8-b666-4309-87ef-30f13419599d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:32.117246 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-31d013c8-b666-4309-87ef-30f13419599d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:32.125438 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-31d013c8-b666-4309-87ef-30f13419599d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.144668 Jun 26 03:14:32.125998 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 480/983] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:31 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:32.259678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-08cf8c37-8367-4675-8e12-775277c7bea6 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f5827587940>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:32.288200 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-08cf8c37-8367-4675-8e12-775277c7bea6 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b" status: 200 len: 286 microversion: 2.1 time: 0.033673 Jun 26 03:14:32.288749 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 504/984] 10.222.0.13 () {58 vars in 1250 bytes} [Sun Jun 26 03:14:32 2022] GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:33.142698 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-31d33b36-2184-4f38-8e13-0c3335f9cec8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:33.143320 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-31d33b36-2184-4f38-8e13-0c3335f9cec8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:33.149711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31d33b36-2184-4f38-8e13-0c3335f9cec8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:33.150219 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31d33b36-2184-4f38-8e13-0c3335f9cec8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:33.151484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31d33b36-2184-4f38-8e13-0c3335f9cec8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:33.151923 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-31d33b36-2184-4f38-8e13-0c3335f9cec8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:33.278611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-31d33b36-2184-4f38-8e13-0c3335f9cec8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:33.285930 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-31d33b36-2184-4f38-8e13-0c3335f9cec8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.147138 Jun 26 03:14:33.286746 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 481/985] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:33 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:33.299985 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c464d5dd-4b50-4eb7-9f51-9230e300b27b tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f58277ac280>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:33.328580 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c464d5dd-4b50-4eb7-9f51-9230e300b27b tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b" status: 200 len: 286 microversion: 2.1 time: 0.032825 Jun 26 03:14:33.329134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 505/986] 10.222.0.13 () {58 vars in 1250 bytes} [Sun Jun 26 03:14:33 2022] GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:14:34.302726 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5d44d758-d280-4733-b4b4-b09fb3b5823a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:34.303433 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5d44d758-d280-4733-b4b4-b09fb3b5823a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:34.309976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5d44d758-d280-4733-b4b4-b09fb3b5823a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:34.310542 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5d44d758-d280-4733-b4b4-b09fb3b5823a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:34.311374 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5d44d758-d280-4733-b4b4-b09fb3b5823a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:34.311870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5d44d758-d280-4733-b4b4-b09fb3b5823a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:34.341254 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0363f52b-d48c-40fd-9edf-bc9330e156df tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f5827713160>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:34.371993 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0363f52b-d48c-40fd-9edf-bc9330e156df tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b" status: 200 len: 286 microversion: 2.1 time: 0.035456 Jun 26 03:14:34.372572 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 506/987] 10.222.0.13 () {58 vars in 1250 bytes} [Sun Jun 26 03:14:34 2022] GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:14:34.529110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5d44d758-d280-4733-b4b4-b09fb3b5823a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:34.537824 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5d44d758-d280-4733-b4b4-b09fb3b5823a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.238923 Jun 26 03:14:34.538443 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 482/988] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:34 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:34.746255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-cf594500-84ce-480c-b49c-977b4cb89005 req-f5ea9111-249f-424a-a415-62cec404a70e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fc861c4-11c3-4fb8-8744-9b792b9864f7", "tag": "f6eda47f-5905-49d5-b36d-bb51bf670b9f"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:34.754557 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-cf594500-84ce-480c-b49c-977b4cb89005 req-f5ea9111-249f-424a-a415-62cec404a70e service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:34.755032 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-cf594500-84ce-480c-b49c-977b4cb89005 req-f5ea9111-249f-424a-a415-62cec404a70e service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:34.774024 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-cf594500-84ce-480c-b49c-977b4cb89005 req-f5ea9111-249f-424a-a415-62cec404a70e service nova] Creating event network-changed:f6eda47f-5905-49d5-b36d-bb51bf670b9f for instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 on hv-cinder-84684 Jun 26 03:14:34.779800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-cf594500-84ce-480c-b49c-977b4cb89005 req-f5ea9111-249f-424a-a415-62cec404a70e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037321 Jun 26 03:14:34.780404 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 507/989] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:14:35.384039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4cca72e9-76ac-47d8-bf09-b0bcbb7402e4 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f58276938b0>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:35.414221 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4cca72e9-76ac-47d8-bf09-b0bcbb7402e4 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b" status: 200 len: 287 microversion: 2.1 time: 0.033862 Jun 26 03:14:35.414799 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 483/990] 10.222.0.13 () {58 vars in 1250 bytes} [Sun Jun 26 03:14:35 2022] GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:35.426211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ecb35f10-6acc-40a9-8a70-90564c0e8077 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f58277ac700>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:35.486212 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ecb35f10-6acc-40a9-8a70-90564c0e8077 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b" status: 202 len: 0 microversion: 2.1 time: 0.063911 Jun 26 03:14:35.486952 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 508/991] 10.222.0.13 () {58 vars in 1253 bytes} [Sun Jun 26 03:14:35 2022] DELETE /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:14:35.495760 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b1fdd513-e7e6-4891-8a81-6e79d73ab25c tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f5827697d30>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:35.525655 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b1fdd513-e7e6-4891-8a81-6e79d73ab25c tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b" status: 200 len: 286 microversion: 2.1 time: 0.034205 Jun 26 03:14:35.526243 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 484/992] 10.222.0.13 () {58 vars in 1250 bytes} [Sun Jun 26 03:14:35 2022] GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:35.555582 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3573a3c1-2ac7-4799-b3ff-ac2e8120dcdf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:35.556315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3573a3c1-2ac7-4799-b3ff-ac2e8120dcdf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:35.568024 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3573a3c1-2ac7-4799-b3ff-ac2e8120dcdf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:35.568474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3573a3c1-2ac7-4799-b3ff-ac2e8120dcdf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:35.573305 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3573a3c1-2ac7-4799-b3ff-ac2e8120dcdf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:35.573794 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3573a3c1-2ac7-4799-b3ff-ac2e8120dcdf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:35.848893 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3573a3c1-2ac7-4799-b3ff-ac2e8120dcdf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:35.858128 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3573a3c1-2ac7-4799-b3ff-ac2e8120dcdf tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.306501 Jun 26 03:14:35.858695 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 509/993] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:35 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:14:36.537210 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3c623739-8c2b-4be7-b580-a30c803ee43c tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f58276d2790>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:36.562678 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-3c623739-8c2b-4be7-b580-a30c803ee43c tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] HTTP exception thrown: Snapshot 1433d877-24c1-4ccc-b747-d580b5c7871b could not be found. Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3c623739-8c2b-4be7-b580-a30c803ee43c tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Request method failure captured: Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b HTTP/1.1 Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit88TVSDgw7PMxmMbluBcnFxkm8zJaa1SEUinOAp8aRDcXyp1gq9LQSPBX9w4ncyzLZly0P2AjYZ-mTuFA7Dwwg3lMOF014b31vNaFxylnQ4y3EeZQzTV3vX-leuDo0A6_TgmD4N8UcvxS2HZPmH9V0ODVeGIIdMakOJnOMPXJH5x-ZE Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 4effe04666a64c43b13c5c173cce4137 Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1724474922 Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:14:36.565762 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:14:36.567387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4effe04666a64c43b13c5c173cce4137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4effe04666a64c43b13c5c173cce4137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4effe04666a64c43b13c5c173cce4137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4effe04666a64c43b13c5c173cce4137"}]}] Jun 26 03:14:36.567387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1724474922 Jun 26 03:14:36.567387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 4effe04666a64c43b13c5c173cce4137 Jun 26 03:14:36.567387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1724474922 Jun 26 03:14:36.567387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-VolumesSnapshotsTestJSON-1724474922-project Jun 26 03:14:36.567387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:14:36.567387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:14:36.567387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 525f63b6795f4be88082e80b7c7dd172 Jun 26 03:14:36.567387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1724474922-project Jun 26 03:14:36.567387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: Jun 26 03:14:36.567387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Snapshot 1433d877-24c1-4ccc-b747-d580b5c7871b could not be found. Jun 26 03:14:36.567387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '1433d877-24c1-4ccc-b747-d580b5c7871b'} Jun 26 03:14:36.567387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1433d877-24c1-4ccc-b747-d580b5c7871b could not be found. (HTTP 404) (Request-ID: req-a20b2443-ef0f-480e-b5bd-32d9226ae311) Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:36.568419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 26 03:14:36.569820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1433d877-24c1-4ccc-b747-d580b5c7871b could not be found. Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 26 03:14:36.571193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:14:36.573277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1433d877-24c1-4ccc-b747-d580b5c7871b could not be found. Jun 26 03:14:36.573277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:36.573277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:36.573277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:36.573277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:36.573277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:36.573277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:36.573277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:14:36.573277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:14:36.573277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1433d877-24c1-4ccc-b747-d580b5c7871b could not be found. Jun 26 03:14:36.573277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:36.573277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3c623739-8c2b-4be7-b580-a30c803ee43c tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Returning 404 to user: Snapshot 1433d877-24c1-4ccc-b747-d580b5c7871b could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:36.573277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3c623739-8c2b-4be7-b580-a30c803ee43c tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b" status: 404 len: 111 microversion: 2.1 time: 0.034462 Jun 26 03:14:36.574348 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 485/994] 10.222.0.13 () {58 vars in 1250 bytes} [Sun Jun 26 03:14:36 2022] GET /compute/v2.1/os-snapshots/1433d877-24c1-4ccc-b747-d580b5c7871b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:14:36.576394 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-7e70b3f1-0915-407c-b859-13171d287066 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f5827587280>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:36.635952 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-7e70b3f1-0915-407c-b859-13171d287066 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd" status: 202 len: 0 microversion: 2.1 time: 0.063243 Jun 26 03:14:36.636656 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 510/995] 10.222.0.13 () {58 vars in 1247 bytes} [Sun Jun 26 03:14:36 2022] DELETE /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:14:36.644758 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-bb823d1d-e391-43a8-97de-82842d006434 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f5827594790>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:36.690714 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-bb823d1d-e391-43a8-97de-82842d006434 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd" status: 200 len: 345 microversion: 2.1 time: 0.049762 Jun 26 03:14:36.691403 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 486/996] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:14:36 2022] GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:36.874432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1b8980f1-983c-44be-a680-96ba6623b525 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:36.875076 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1b8980f1-983c-44be-a680-96ba6623b525 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:36.881280 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1b8980f1-983c-44be-a680-96ba6623b525 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:36.881777 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1b8980f1-983c-44be-a680-96ba6623b525 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:36.882711 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1b8980f1-983c-44be-a680-96ba6623b525 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:36.883262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1b8980f1-983c-44be-a680-96ba6623b525 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:37.012121 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1b8980f1-983c-44be-a680-96ba6623b525 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:37.019589 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1b8980f1-983c-44be-a680-96ba6623b525 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.149490 Jun 26 03:14:37.024939 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 511/997] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:36 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:37.704048 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-010d1148-1dbd-44cf-ada0-c824aba2215a tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f58276d2dc0>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:37.733250 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-010d1148-1dbd-44cf-ada0-c824aba2215a tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] HTTP exception thrown: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-010d1148-1dbd-44cf-ada0-c824aba2215a tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Request method failure captured: Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd HTTP/1.1 Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit88TVSDgw7PMxmMbluBcnFxkm8zJaa1SEUinOAp8aRDcXyp1gq9LQSPBX9w4ncyzLZly0P2AjYZ-mTuFA7Dwwg3lMOF014b31vNaFxylnQ4y3EeZQzTV3vX-leuDo0A6_TgmD4N8UcvxS2HZPmH9V0ODVeGIIdMakOJnOMPXJH5x-ZE Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 4effe04666a64c43b13c5c173cce4137 Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1724474922 Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:14:37.735520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:14:37.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4effe04666a64c43b13c5c173cce4137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4effe04666a64c43b13c5c173cce4137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4effe04666a64c43b13c5c173cce4137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4effe04666a64c43b13c5c173cce4137"}]}] Jun 26 03:14:37.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1724474922 Jun 26 03:14:37.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 4effe04666a64c43b13c5c173cce4137 Jun 26 03:14:37.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1724474922 Jun 26 03:14:37.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-VolumesSnapshotsTestJSON-1724474922-project Jun 26 03:14:37.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:14:37.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:14:37.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 525f63b6795f4be88082e80b7c7dd172 Jun 26 03:14:37.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1724474922-project Jun 26 03:14:37.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: Jun 26 03:14:37.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd'} Jun 26 03:14:37.737156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. (HTTP 404) (Request-ID: req-e41071cc-7dcf-437d-a2f2-e58d7dd6465a) Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:37.738145 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 26 03:14:37.739643 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 26 03:14:37.740981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-010d1148-1dbd-44cf-ada0-c824aba2215a tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Returning 404 to user: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-010d1148-1dbd-44cf-ada0-c824aba2215a tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd" status: 404 len: 109 microversion: 2.1 time: 0.037340 Jun 26 03:14:37.742311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 487/998] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:14:37 2022] GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:14:37.747203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-047b71a0-068f-42bf-b3cc-3ba2e3db2174 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f5827587280>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:37.775216 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-047b71a0-068f-42bf-b3cc-3ba2e3db2174 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] HTTP exception thrown: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-047b71a0-068f-42bf-b3cc-3ba2e3db2174 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Request method failure captured: Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: DELETE /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd HTTP/1.1 Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit88TVSDgw7PMxmMbluBcnFxkm8zJaa1SEUinOAp8aRDcXyp1gq9LQSPBX9w4ncyzLZly0P2AjYZ-mTuFA7Dwwg3lMOF014b31vNaFxylnQ4y3EeZQzTV3vX-leuDo0A6_TgmD4N8UcvxS2HZPmH9V0ODVeGIIdMakOJnOMPXJH5x-ZE Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 4effe04666a64c43b13c5c173cce4137 Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1724474922 Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:14:37.777920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:14:37.779506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4effe04666a64c43b13c5c173cce4137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4effe04666a64c43b13c5c173cce4137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4effe04666a64c43b13c5c173cce4137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4effe04666a64c43b13c5c173cce4137"}]}] Jun 26 03:14:37.779506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1724474922 Jun 26 03:14:37.779506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 4effe04666a64c43b13c5c173cce4137 Jun 26 03:14:37.779506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1724474922 Jun 26 03:14:37.779506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-VolumesSnapshotsTestJSON-1724474922-project Jun 26 03:14:37.779506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:14:37.779506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:14:37.779506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 525f63b6795f4be88082e80b7c7dd172 Jun 26 03:14:37.779506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1724474922-project Jun 26 03:14:37.779506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: Jun 26 03:14:37.779506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.779506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd'} Jun 26 03:14:37.779506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. (HTTP 404) (Request-ID: req-b6312fd3-f49c-475c-9004-669974cbd2fa) Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:37.780464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 26 03:14:37.781843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 26 03:14:37.783251 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-047b71a0-068f-42bf-b3cc-3ba2e3db2174 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Returning 404 to user: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-047b71a0-068f-42bf-b3cc-3ba2e3db2174 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd" status: 404 len: 109 microversion: 2.1 time: 0.036168 Jun 26 03:14:37.784606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 512/999] 10.222.0.13 () {58 vars in 1247 bytes} [Sun Jun 26 03:14:37 2022] DELETE /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:14:37.787516 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-68e28a25-c48e-4a47-a3da-c456bbdb6cb9 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Calling method '.version_select at 0x7f5827697f70>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:37.813374 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-68e28a25-c48e-4a47-a3da-c456bbdb6cb9 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] HTTP exception thrown: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-68e28a25-c48e-4a47-a3da-c456bbdb6cb9 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Request method failure captured: Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd HTTP/1.1 Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit88TVSDgw7PMxmMbluBcnFxkm8zJaa1SEUinOAp8aRDcXyp1gq9LQSPBX9w4ncyzLZly0P2AjYZ-mTuFA7Dwwg3lMOF014b31vNaFxylnQ4y3EeZQzTV3vX-leuDo0A6_TgmD4N8UcvxS2HZPmH9V0ODVeGIIdMakOJnOMPXJH5x-ZE Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 4effe04666a64c43b13c5c173cce4137 Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1724474922 Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:14:37.815332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:14:37.816955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4effe04666a64c43b13c5c173cce4137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4effe04666a64c43b13c5c173cce4137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4effe04666a64c43b13c5c173cce4137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4effe04666a64c43b13c5c173cce4137"}]}] Jun 26 03:14:37.816955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1724474922 Jun 26 03:14:37.816955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 4effe04666a64c43b13c5c173cce4137 Jun 26 03:14:37.816955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1724474922 Jun 26 03:14:37.816955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-VolumesSnapshotsTestJSON-1724474922-project Jun 26 03:14:37.816955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:14:37.816955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:14:37.816955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 525f63b6795f4be88082e80b7c7dd172 Jun 26 03:14:37.816955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1724474922-project Jun 26 03:14:37.816955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: Jun 26 03:14:37.816955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.816955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd'} Jun 26 03:14:37.816955 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. (HTTP 404) (Request-ID: req-fbb17c05-b5d8-45f1-9ca6-093e9c89fea3) Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:37.817883 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 26 03:14:37.819410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 26 03:14:37.820692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-68e28a25-c48e-4a47-a3da-c456bbdb6cb9 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] Returning 404 to user: Volume 7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-68e28a25-c48e-4a47-a3da-c456bbdb6cb9 tempest-VolumesSnapshotsTestJSON-1724474922 tempest-VolumesSnapshotsTestJSON-1724474922-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd" status: 404 len: 109 microversion: 2.1 time: 0.032960 Jun 26 03:14:37.822418 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 488/1000] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:14:37 2022] GET /compute/v2.1/os-volumes/7f3cd3d4-d3fd-4f37-b06d-0cce1812dddd => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:14:38.036086 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ac838bdb-3013-44b1-8f73-61abf15cdda8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:38.036828 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ac838bdb-3013-44b1-8f73-61abf15cdda8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:38.043485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac838bdb-3013-44b1-8f73-61abf15cdda8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:38.043940 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac838bdb-3013-44b1-8f73-61abf15cdda8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:38.044697 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac838bdb-3013-44b1-8f73-61abf15cdda8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:38.045131 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ac838bdb-3013-44b1-8f73-61abf15cdda8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:38.185356 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ac838bdb-3013-44b1-8f73-61abf15cdda8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:38.194304 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ac838bdb-3013-44b1-8f73-61abf15cdda8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.161870 Jun 26 03:14:38.195670 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 513/1001] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:38 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:39.162468 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-50e194c5-b6f7-43c7-bd92-aca5146205c7 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Action: 'create', calling method: .version_select at 0x7f58276d2310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-672067393", "metadata": {"Type": "work"}}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-50e194c5-b6f7-43c7-bd92-aca5146205c7 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Request method failure captured: Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 121 Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit88epILJ5pCjRRCx-uzyisvkTcbbpjmDEnANkk8DdnybhHlkERSKKHblwC2nDjWfBc9hlPzzNWaAiMzHuGFuIFn2MwYo_E8uVQD5UdKBCAhTcuhB_AjwIZutPIS_BeRtOkA2Lqk3tWWxoEoypFY0b8iUOcuLivACPlxlMPZ8a34c-7A Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: e638c1a29b7c4b298a0f6aafd1b280f0 Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:14:39.189079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:14:39.190793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e638c1a29b7c4b298a0f6aafd1b280f0"}]}] Jun 26 03:14:39.190793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.190793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: e638c1a29b7c4b298a0f6aafd1b280f0 Jun 26 03:14:39.190793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.190793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-VolumesNegativeTest-1979869954-project Jun 26 03:14:39.190793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:14:39.190793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:14:39.190793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 1e2ce0dbb7704a2bb7f3f49e84478370 Jun 26 03:14:39.190793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-VolumesNegativeTest-1979869954-project Jun 26 03:14:39.190793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Jun 26 03:14:39.190793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-672067393", "metadata": {"Type": "work"}}} Jun 26 03:14:39.190793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: Jun 26 03:14:39.190793 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-672067393', 'metadata': {'Type': 'work'}}}} Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise error Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi '#$%' Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:39.191745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 26 03:14:39.193114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 26 03:14:39.194293 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 26 03:14:39.194293 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.194293 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-50e194c5-b6f7-43c7-bd92-aca5146205c7 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:39.194293 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-50e194c5-b6f7-43c7-bd92-aca5146205c7 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.144445 Jun 26 03:14:39.194293 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 489/1002] 10.222.0.13 () {60 vars in 1155 bytes} [Sun Jun 26 03:14:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 26 03:14:39.200979 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c4819930-8b39-418b-a0db-6e009016cf27 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Action: 'create', calling method: .version_select at 0x7f5827713160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1336723939", "metadata": {"Type": "work"}}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c4819930-8b39-418b-a0db-6e009016cf27 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Request method failure captured: Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 120 Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit88epILJ5pCjRRCx-uzyisvkTcbbpjmDEnANkk8DdnybhHlkERSKKHblwC2nDjWfBc9hlPzzNWaAiMzHuGFuIFn2MwYo_E8uVQD5UdKBCAhTcuhB_AjwIZutPIS_BeRtOkA2Lqk3tWWxoEoypFY0b8iUOcuLivACPlxlMPZ8a34c-7A Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: e638c1a29b7c4b298a0f6aafd1b280f0 Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:14:39.204564 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:14:39.206147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e638c1a29b7c4b298a0f6aafd1b280f0"}]}] Jun 26 03:14:39.206147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.206147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: e638c1a29b7c4b298a0f6aafd1b280f0 Jun 26 03:14:39.206147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.206147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-VolumesNegativeTest-1979869954-project Jun 26 03:14:39.206147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:14:39.206147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:14:39.206147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 1e2ce0dbb7704a2bb7f3f49e84478370 Jun 26 03:14:39.206147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-VolumesNegativeTest-1979869954-project Jun 26 03:14:39.206147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Jun 26 03:14:39.206147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1336723939", "metadata": {"Type": "work"}}} Jun 26 03:14:39.206147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: Jun 26 03:14:39.206147 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1336723939', 'metadata': {'Type': 'work'}}}} Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise error Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi '0' Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:39.207082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 26 03:14:39.208577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 26 03:14:39.209845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 26 03:14:39.209845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.209845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c4819930-8b39-418b-a0db-6e009016cf27 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:39.209845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c4819930-8b39-418b-a0db-6e009016cf27 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009611 Jun 26 03:14:39.209845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 514/1003] 10.222.0.13 () {60 vars in 1155 bytes} [Sun Jun 26 03:14:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 26 03:14:39.210223 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c6cfe23e-013f-495d-aac3-0d08b4980638 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:39.210757 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c6cfe23e-013f-495d-aac3-0d08b4980638 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:39.216975 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e6e6bc94-7ed7-437c-842d-02adf076a624 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Action: 'create', calling method: .version_select at 0x7f5827582f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1977860380", "metadata": {"Type": "work"}}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:39.217520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c6cfe23e-013f-495d-aac3-0d08b4980638 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:39.217971 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c6cfe23e-013f-495d-aac3-0d08b4980638 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:39.218764 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c6cfe23e-013f-495d-aac3-0d08b4980638 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:39.219196 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c6cfe23e-013f-495d-aac3-0d08b4980638 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e6e6bc94-7ed7-437c-842d-02adf076a624 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Request method failure captured: Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 119 Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit88epILJ5pCjRRCx-uzyisvkTcbbpjmDEnANkk8DdnybhHlkERSKKHblwC2nDjWfBc9hlPzzNWaAiMzHuGFuIFn2MwYo_E8uVQD5UdKBCAhTcuhB_AjwIZutPIS_BeRtOkA2Lqk3tWWxoEoypFY0b8iUOcuLivACPlxlMPZ8a34c-7A Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: e638c1a29b7c4b298a0f6aafd1b280f0 Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:14:39.219389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:14:39.220931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e638c1a29b7c4b298a0f6aafd1b280f0"}]}] Jun 26 03:14:39.220931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.220931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: e638c1a29b7c4b298a0f6aafd1b280f0 Jun 26 03:14:39.220931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.220931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-VolumesNegativeTest-1979869954-project Jun 26 03:14:39.220931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:14:39.220931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:14:39.220931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 1e2ce0dbb7704a2bb7f3f49e84478370 Jun 26 03:14:39.220931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-VolumesNegativeTest-1979869954-project Jun 26 03:14:39.220931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Jun 26 03:14:39.220931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1977860380", "metadata": {"Type": "work"}}} Jun 26 03:14:39.220931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: Jun 26 03:14:39.220931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1977860380', 'metadata': {'Type': 'work'}}}} Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise error Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi '' Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:39.222034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 26 03:14:39.223532 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 26 03:14:39.224797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 26 03:14:39.224797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.224797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e6e6bc94-7ed7-437c-842d-02adf076a624 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:39.224797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e6e6bc94-7ed7-437c-842d-02adf076a624 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008512 Jun 26 03:14:39.224797 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 515/1004] 10.222.0.13 () {60 vars in 1155 bytes} [Sun Jun 26 03:14:39 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 26 03:14:39.230798 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e7cddfde-c509-4eea-a4c5-e07c09351da5 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Calling method '.version_select at 0x7f58275820d0>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:39.259412 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-e7cddfde-c509-4eea-a4c5-e07c09351da5 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] HTTP exception thrown: Volume tempest-invalid-153083601 could not be found. Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e7cddfde-c509-4eea-a4c5-e07c09351da5 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Request method failure captured: Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-153083601 HTTP/1.1 Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit88epILJ5pCjRRCx-uzyisvkTcbbpjmDEnANkk8DdnybhHlkERSKKHblwC2nDjWfBc9hlPzzNWaAiMzHuGFuIFn2MwYo_E8uVQD5UdKBCAhTcuhB_AjwIZutPIS_BeRtOkA2Lqk3tWWxoEoypFY0b8iUOcuLivACPlxlMPZ8a34c-7A Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: e638c1a29b7c4b298a0f6aafd1b280f0 Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:14:39.261368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:14:39.263432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e638c1a29b7c4b298a0f6aafd1b280f0"}]}] Jun 26 03:14:39.263432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.263432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: e638c1a29b7c4b298a0f6aafd1b280f0 Jun 26 03:14:39.263432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.263432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-VolumesNegativeTest-1979869954-project Jun 26 03:14:39.263432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:14:39.263432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:14:39.263432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 1e2ce0dbb7704a2bb7f3f49e84478370 Jun 26 03:14:39.263432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-VolumesNegativeTest-1979869954-project Jun 26 03:14:39.263432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: Jun 26 03:14:39.263432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Volume tempest-invalid-153083601 could not be found. Jun 26 03:14:39.263432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': 'tempest-invalid-153083601'} Jun 26 03:14:39.263432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-153083601 could not be found. (HTTP 404) (Request-ID: req-1f9fd599-99ad-47b9-979a-cf9485145ab9) Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.264320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 26 03:14:39.265473 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-153083601 could not be found. Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:14:39.266712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-153083601 could not be found. Jun 26 03:14:39.267875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.267875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.267875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.267875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.267875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:39.267875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:39.267875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:14:39.267875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:14:39.267875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-153083601 could not be found. Jun 26 03:14:39.267875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.267875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e7cddfde-c509-4eea-a4c5-e07c09351da5 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Returning 404 to user: Volume tempest-invalid-153083601 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:39.267875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e7cddfde-c509-4eea-a4c5-e07c09351da5 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-153083601" status: 404 len: 98 microversion: 2.1 time: 0.037320 Jun 26 03:14:39.267875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 516/1005] 10.222.0.13 () {58 vars in 1214 bytes} [Sun Jun 26 03:14:39 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-153083601 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 26 03:14:39.273146 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2857ddb7-496a-4c86-9fa8-65f16399ec18 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003731 Jun 26 03:14:39.273649 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 517/1006] 10.222.0.13 () {58 vars in 1139 bytes} [Sun Jun 26 03:14:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 26 03:14:39.282652 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-940f8656-9b78-4a38-82b8-3a558858ab99 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004358 Jun 26 03:14:39.283151 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 518/1007] 10.222.0.13 () {58 vars in 1136 bytes} [Sun Jun 26 03:14:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 26 03:14:39.291089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d6c4a2c0-f014-42fd-b0d8-4bd12f1bfd54 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Calling method '.version_select at 0x7f582c3f81f0>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:39.318106 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-d6c4a2c0-f014-42fd-b0d8-4bd12f1bfd54 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] HTTP exception thrown: Volume 8153edbc-9afb-488f-bd86-598d5528f665 could not be found. Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d6c4a2c0-f014-42fd-b0d8-4bd12f1bfd54 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Request method failure captured: Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: DELETE /compute/v2.1/os-volumes/8153edbc-9afb-488f-bd86-598d5528f665 HTTP/1.1 Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit88epILJ5pCjRRCx-uzyisvkTcbbpjmDEnANkk8DdnybhHlkERSKKHblwC2nDjWfBc9hlPzzNWaAiMzHuGFuIFn2MwYo_E8uVQD5UdKBCAhTcuhB_AjwIZutPIS_BeRtOkA2Lqk3tWWxoEoypFY0b8iUOcuLivACPlxlMPZ8a34c-7A Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: e638c1a29b7c4b298a0f6aafd1b280f0 Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:14:39.320634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:14:39.322203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e638c1a29b7c4b298a0f6aafd1b280f0"}]}] Jun 26 03:14:39.322203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.322203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: e638c1a29b7c4b298a0f6aafd1b280f0 Jun 26 03:14:39.322203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.322203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-VolumesNegativeTest-1979869954-project Jun 26 03:14:39.322203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:14:39.322203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:14:39.322203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 1e2ce0dbb7704a2bb7f3f49e84478370 Jun 26 03:14:39.322203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-VolumesNegativeTest-1979869954-project Jun 26 03:14:39.322203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: Jun 26 03:14:39.322203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Volume 8153edbc-9afb-488f-bd86-598d5528f665 could not be found. Jun 26 03:14:39.322203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '8153edbc-9afb-488f-bd86-598d5528f665'} Jun 26 03:14:39.322203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8153edbc-9afb-488f-bd86-598d5528f665 could not be found. (HTTP 404) (Request-ID: req-14300888-20cb-47a3-94e8-37598a2c0538) Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.323169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 26 03:14:39.324455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8153edbc-9afb-488f-bd86-598d5528f665 could not be found. Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 26 03:14:39.326262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8153edbc-9afb-488f-bd86-598d5528f665 could not be found. Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8153edbc-9afb-488f-bd86-598d5528f665 could not be found. Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d6c4a2c0-f014-42fd-b0d8-4bd12f1bfd54 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Returning 404 to user: Volume 8153edbc-9afb-488f-bd86-598d5528f665 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d6c4a2c0-f014-42fd-b0d8-4bd12f1bfd54 tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/8153edbc-9afb-488f-bd86-598d5528f665" status: 404 len: 109 microversion: 2.1 time: 0.035025 Jun 26 03:14:39.327998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 519/1008] 10.222.0.13 () {58 vars in 1247 bytes} [Sun Jun 26 03:14:39 2022] DELETE /compute/v2.1/os-volumes/8153edbc-9afb-488f-bd86-598d5528f665 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 26 03:14:39.333332 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-63f36cd5-09ca-41fd-9cf0-438dce4a87ef tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Calling method '.version_select at 0x7f5827587a60>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:39.355164 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c6cfe23e-013f-495d-aac3-0d08b4980638 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:39.361467 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-63f36cd5-09ca-41fd-9cf0-438dce4a87ef tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] HTTP exception thrown: Volume c66cafa3-0f65-45e3-82e2-7fbdafcb3393 could not be found. Jun 26 03:14:39.362926 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c6cfe23e-013f-495d-aac3-0d08b4980638 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.156591 Jun 26 03:14:39.363497 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 490/1009] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:39 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-63f36cd5-09ca-41fd-9cf0-438dce4a87ef tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Request method failure captured: Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/os-volumes/c66cafa3-0f65-45e3-82e2-7fbdafcb3393 HTTP/1.1 Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit88epILJ5pCjRRCx-uzyisvkTcbbpjmDEnANkk8DdnybhHlkERSKKHblwC2nDjWfBc9hlPzzNWaAiMzHuGFuIFn2MwYo_E8uVQD5UdKBCAhTcuhB_AjwIZutPIS_BeRtOkA2Lqk3tWWxoEoypFY0b8iUOcuLivACPlxlMPZ8a34c-7A Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: e638c1a29b7c4b298a0f6aafd1b280f0 Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:14:39.365225 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:14:39.366806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e638c1a29b7c4b298a0f6aafd1b280f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e638c1a29b7c4b298a0f6aafd1b280f0"}]}] Jun 26 03:14:39.366806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.366806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: e638c1a29b7c4b298a0f6aafd1b280f0 Jun 26 03:14:39.366806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-VolumesNegativeTest-1979869954 Jun 26 03:14:39.366806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-VolumesNegativeTest-1979869954-project Jun 26 03:14:39.366806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:14:39.366806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:14:39.366806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 1e2ce0dbb7704a2bb7f3f49e84478370 Jun 26 03:14:39.366806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-VolumesNegativeTest-1979869954-project Jun 26 03:14:39.366806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: Jun 26 03:14:39.366806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Volume c66cafa3-0f65-45e3-82e2-7fbdafcb3393 could not be found. Jun 26 03:14:39.366806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': 'c66cafa3-0f65-45e3-82e2-7fbdafcb3393'} Jun 26 03:14:39.366806 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c66cafa3-0f65-45e3-82e2-7fbdafcb3393 could not be found. (HTTP 404) (Request-ID: req-ac876a3d-b0e2-43f0-bbd0-a1b876e5c742) Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.367804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 26 03:14:39.369229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c66cafa3-0f65-45e3-82e2-7fbdafcb3393 could not be found. Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 26 03:14:39.370463 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c66cafa3-0f65-45e3-82e2-7fbdafcb3393 could not be found. Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c66cafa3-0f65-45e3-82e2-7fbdafcb3393 could not be found. Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-63f36cd5-09ca-41fd-9cf0-438dce4a87ef tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] Returning 404 to user: Volume c66cafa3-0f65-45e3-82e2-7fbdafcb3393 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-63f36cd5-09ca-41fd-9cf0-438dce4a87ef tempest-VolumesNegativeTest-1979869954 tempest-VolumesNegativeTest-1979869954-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c66cafa3-0f65-45e3-82e2-7fbdafcb3393" status: 404 len: 109 microversion: 2.1 time: 0.036965 Jun 26 03:14:39.371780 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 520/1010] 10.222.0.13 () {58 vars in 1244 bytes} [Sun Jun 26 03:14:39 2022] GET /compute/v2.1/os-volumes/c66cafa3-0f65-45e3-82e2-7fbdafcb3393 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 26 03:14:39.557971 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-657dd7be-aa12-46ba-883f-9705d4ed4c08 req-f5c3fa78-ffcf-4081-8f8a-6185dfc5af0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc861c4-11c3-4fb8-8744-9b792b9864f7", "name": "network-vif-plugged", "status": "completed", "tag": "f6eda47f-5905-49d5-b36d-bb51bf670b9f"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:39.567996 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-657dd7be-aa12-46ba-883f-9705d4ed4c08 req-f5c3fa78-ffcf-4081-8f8a-6185dfc5af0d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:39.568476 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-657dd7be-aa12-46ba-883f-9705d4ed4c08 req-f5c3fa78-ffcf-4081-8f8a-6185dfc5af0d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:39.582582 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-657dd7be-aa12-46ba-883f-9705d4ed4c08 req-f5c3fa78-ffcf-4081-8f8a-6185dfc5af0d service nova] Creating event network-vif-plugged:f6eda47f-5905-49d5-b36d-bb51bf670b9f for instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 on hv-cinder-84684 Jun 26 03:14:39.587867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-657dd7be-aa12-46ba-883f-9705d4ed4c08 req-f5c3fa78-ffcf-4081-8f8a-6185dfc5af0d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034719 Jun 26 03:14:39.588593 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 491/1011] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:40.381070 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4ea8ba20-d8ea-4ec7-8bbf-438472978c8a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:40.382378 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4ea8ba20-d8ea-4ec7-8bbf-438472978c8a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:40.388819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4ea8ba20-d8ea-4ec7-8bbf-438472978c8a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:40.389346 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4ea8ba20-d8ea-4ec7-8bbf-438472978c8a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:40.390233 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4ea8ba20-d8ea-4ec7-8bbf-438472978c8a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:40.390748 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4ea8ba20-d8ea-4ec7-8bbf-438472978c8a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:40.532495 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4ea8ba20-d8ea-4ec7-8bbf-438472978c8a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:40.539819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4ea8ba20-d8ea-4ec7-8bbf-438472978c8a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.164037 Jun 26 03:14:40.540360 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 521/1012] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:40 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:41.557550 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-10f71610-13de-4fd8-b0eb-3c719daf6b0b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:41.558743 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-10f71610-13de-4fd8-b0eb-3c719daf6b0b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:41.565489 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10f71610-13de-4fd8-b0eb-3c719daf6b0b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:41.566239 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10f71610-13de-4fd8-b0eb-3c719daf6b0b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:41.567013 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10f71610-13de-4fd8-b0eb-3c719daf6b0b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:41.567453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10f71610-13de-4fd8-b0eb-3c719daf6b0b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:41.704563 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-10f71610-13de-4fd8-b0eb-3c719daf6b0b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:41.713094 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-10f71610-13de-4fd8-b0eb-3c719daf6b0b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1358 microversion: 2.1 time: 0.160120 Jun 26 03:14:41.713714 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 492/1013] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:41 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:42.728673 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-698bdab6-587c-43fc-9af9-431485c760a3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:42.729433 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-698bdab6-587c-43fc-9af9-431485c760a3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:42.736031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-698bdab6-587c-43fc-9af9-431485c760a3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:42.736495 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-698bdab6-587c-43fc-9af9-431485c760a3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:42.737273 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-698bdab6-587c-43fc-9af9-431485c760a3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:42.737720 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-698bdab6-587c-43fc-9af9-431485c760a3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:42.742102 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:42.900217 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-698bdab6-587c-43fc-9af9-431485c760a3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:42.908928 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-698bdab6-587c-43fc-9af9-431485c760a3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1549 microversion: 2.1 time: 0.184084 Jun 26 03:14:42.909517 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 522/1014] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:42 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1549 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:42.924983 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-84c9e12d-dd11-49e9-9472-19fefca59b0d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:42.925598 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-84c9e12d-dd11-49e9-9472-19fefca59b0d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:42.932178 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-84c9e12d-dd11-49e9-9472-19fefca59b0d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:42.932635 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-84c9e12d-dd11-49e9-9472-19fefca59b0d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:42.933409 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-84c9e12d-dd11-49e9-9472-19fefca59b0d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:42.933889 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-84c9e12d-dd11-49e9-9472-19fefca59b0d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:43.065818 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-84c9e12d-dd11-49e9-9472-19fefca59b0d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:43.073171 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-84c9e12d-dd11-49e9-9472-19fefca59b0d tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1549 microversion: 2.1 time: 0.151966 Jun 26 03:14:43.076316 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 493/1015] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:42 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:43.088314 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c418a519-9833-4e66-81b0-b65da5018fd4 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:43.091844 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c418a519-9833-4e66-81b0-b65da5018fd4 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:43.092671 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c418a519-9833-4e66-81b0-b65da5018fd4 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Searching by: {'deleted': False, 'project_id': '1fe0cd601688420d88ea051894cfdf2a'} {{(pid=117783) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 26 03:14:43.099262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c418a519-9833-4e66-81b0-b65da5018fd4 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:43.099659 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c418a519-9833-4e66-81b0-b65da5018fd4 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:43.100468 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c418a519-9833-4e66-81b0-b65da5018fd4 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:43.100917 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c418a519-9833-4e66-81b0-b65da5018fd4 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:43.192355 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.multi_cell_list [None req-c418a519-9833-4e66-81b0-b65da5018fd4 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117783) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 26 03:14:43.289868 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c418a519-9833-4e66-81b0-b65da5018fd4 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.205238 Jun 26 03:14:43.295958 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 523/1016] 10.222.0.13 () {58 vars in 1124 bytes} [Sun Jun 26 03:14:43 2022] GET /compute/v2.1/servers => generated 342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:43.301036 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c8cc479f-2cb9-4c0d-8c2b-c90c73c56522 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:43.301685 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c8cc479f-2cb9-4c0d-8c2b-c90c73c56522 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:43.307599 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c8cc479f-2cb9-4c0d-8c2b-c90c73c56522 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:43.308059 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c8cc479f-2cb9-4c0d-8c2b-c90c73c56522 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:43.308835 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c8cc479f-2cb9-4c0d-8c2b-c90c73c56522 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:43.309308 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c8cc479f-2cb9-4c0d-8c2b-c90c73c56522 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:43.440930 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c8cc479f-2cb9-4c0d-8c2b-c90c73c56522 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:43.448249 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c8cc479f-2cb9-4c0d-8c2b-c90c73c56522 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1549 microversion: 2.1 time: 0.151063 Jun 26 03:14:43.448875 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 494/1017] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:43 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:44.990397 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8dff94ea-6098-4587-b1e7-9a0e611d7489 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b45e8ece-707c-484a-a274-a379b3d2859b"}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:44.991526 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8dff94ea-6098-4587-b1e7-9a0e611d7489 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:44.994021 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:44.999527 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8dff94ea-6098-4587-b1e7-9a0e611d7489 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:44.999975 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8dff94ea-6098-4587-b1e7-9a0e611d7489 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:45.000735 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8dff94ea-6098-4587-b1e7-9a0e611d7489 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:45.001172 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8dff94ea-6098-4587-b1e7-9a0e611d7489 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:45.247583 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8dff94ea-6098-4587-b1e7-9a0e611d7489 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "POST /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261084 Jun 26 03:14:45.248203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 524/1018] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:14:44 2022] POST /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:45.992446 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-96624689-b8ef-4055-8d25-e61de9ca5b62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:45.992929 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-96624689-b8ef-4055-8d25-e61de9ca5b62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:45.998853 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-96624689-b8ef-4055-8d25-e61de9ca5b62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:45.999303 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-96624689-b8ef-4055-8d25-e61de9ca5b62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:46.000066 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-96624689-b8ef-4055-8d25-e61de9ca5b62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:46.000526 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-96624689-b8ef-4055-8d25-e61de9ca5b62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:46.023766 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-96624689-b8ef-4055-8d25-e61de9ca5b62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2/ips" status: 200 len: 149 microversion: 2.1 time: 0.035419 Jun 26 03:14:46.024313 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 495/1019] 10.222.0.13 () {58 vars in 1247 bytes} [Sun Jun 26 03:14:45 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:47.348994 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9d82dfb9-888a-4fe7-9499-070dbf465d27 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd54af81-c782-48ae-9199-84371d3e84bd"}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:47.350271 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9d82dfb9-888a-4fe7-9499-070dbf465d27 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:47.357095 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9d82dfb9-888a-4fe7-9499-070dbf465d27 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:47.357555 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9d82dfb9-888a-4fe7-9499-070dbf465d27 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:47.358356 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9d82dfb9-888a-4fe7-9499-070dbf465d27 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:47.358804 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9d82dfb9-888a-4fe7-9499-070dbf465d27 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:47.629670 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9d82dfb9-888a-4fe7-9499-070dbf465d27 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "POST /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285197 Jun 26 03:14:47.630332 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 525/1020] 10.222.0.13 () {60 vars in 1322 bytes} [Sun Jun 26 03:14:47 2022] POST /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:52.799765 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-61221d91-4817-4995-b5fb-a79ed8180895 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:52.800386 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-61221d91-4817-4995-b5fb-a79ed8180895 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:52.803081 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=34 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:52.808716 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-61221d91-4817-4995-b5fb-a79ed8180895 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:52.809308 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-61221d91-4817-4995-b5fb-a79ed8180895 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:52.810731 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-61221d91-4817-4995-b5fb-a79ed8180895 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:52.811179 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-61221d91-4817-4995-b5fb-a79ed8180895 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:52.815370 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=88 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:53.115032 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-61221d91-4817-4995-b5fb-a79ed8180895 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:53.122969 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-61221d91-4817-4995-b5fb-a79ed8180895 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1595 microversion: 2.1 time: 0.327145 Jun 26 03:14:53.123534 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 496/1021] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:52 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1595 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:54.807647 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-f79ef080-f31b-420c-b0ad-dbb3b3a4cfbd req-5f4d021e-710b-41ce-ba91-40d3327ac744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fc861c4-11c3-4fb8-8744-9b792b9864f7", "tag": "f6eda47f-5905-49d5-b36d-bb51bf670b9f"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:54.815210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=2 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:54.817801 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-f79ef080-f31b-420c-b0ad-dbb3b3a4cfbd req-5f4d021e-710b-41ce-ba91-40d3327ac744 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:54.818534 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-f79ef080-f31b-420c-b0ad-dbb3b3a4cfbd req-5f4d021e-710b-41ce-ba91-40d3327ac744 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:54.831764 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-f79ef080-f31b-420c-b0ad-dbb3b3a4cfbd req-5f4d021e-710b-41ce-ba91-40d3327ac744 service nova] Creating event network-changed:f6eda47f-5905-49d5-b36d-bb51bf670b9f for instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 on hv-cinder-84684 Jun 26 03:14:54.836958 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-f79ef080-f31b-420c-b0ad-dbb3b3a4cfbd req-5f4d021e-710b-41ce-ba91-40d3327ac744 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033563 Jun 26 03:14:54.838304 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 526/1022] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:14:55.809387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d531e224-a834-4b08-959b-ad1cf4c66767 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1274287002"}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:55.810496 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d531e224-a834-4b08-959b-ad1cf4c66767 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:55.817138 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d531e224-a834-4b08-959b-ad1cf4c66767 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:55.817664 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d531e224-a834-4b08-959b-ad1cf4c66767 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:55.818539 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d531e224-a834-4b08-959b-ad1cf4c66767 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:55.819050 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d531e224-a834-4b08-959b-ad1cf4c66767 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:55.958544 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.network.security_group_api [None req-d531e224-a834-4b08-959b-ad1cf4c66767 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Adding security group 04e92ec5-b39d-4c95-a918-6367021dd02f to port f6eda47f-5905-49d5-b36d-bb51bf670b9f Jun 26 03:14:56.326939 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d531e224-a834-4b08-959b-ad1cf4c66767 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "POST /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/action" status: 202 len: 0 microversion: 2.1 time: 0.521753 Jun 26 03:14:56.327741 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 497/1023] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:14:55 2022] POST /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:14:56.340496 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-72889dc1-a922-41d3-8c5d-935409f1f512 req-421666e9-3234-4500-8902-32908699c365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fc861c4-11c3-4fb8-8744-9b792b9864f7", "tag": "f6eda47f-5905-49d5-b36d-bb51bf670b9f"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:14:56.342485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-eed90b5a-20bf-4a60-85b2-4d8e56b39914 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:56.343200 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-eed90b5a-20bf-4a60-85b2-4d8e56b39914 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:56.361530 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-72889dc1-a922-41d3-8c5d-935409f1f512 req-421666e9-3234-4500-8902-32908699c365 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:56.363794 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-eed90b5a-20bf-4a60-85b2-4d8e56b39914 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:56.364347 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-eed90b5a-20bf-4a60-85b2-4d8e56b39914 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:56.364816 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-72889dc1-a922-41d3-8c5d-935409f1f512 req-421666e9-3234-4500-8902-32908699c365 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:56.365654 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-eed90b5a-20bf-4a60-85b2-4d8e56b39914 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:56.367448 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-eed90b5a-20bf-4a60-85b2-4d8e56b39914 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:56.385349 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-72889dc1-a922-41d3-8c5d-935409f1f512 req-421666e9-3234-4500-8902-32908699c365 service nova] Creating event network-changed:f6eda47f-5905-49d5-b36d-bb51bf670b9f for instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 on hv-cinder-84684 Jun 26 03:14:56.404404 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-72889dc1-a922-41d3-8c5d-935409f1f512 req-421666e9-3234-4500-8902-32908699c365 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066084 Jun 26 03:14:56.408531 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 498/1024] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:14:56.678106 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-eed90b5a-20bf-4a60-85b2-4d8e56b39914 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:14:56.689154 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-eed90b5a-20bf-4a60-85b2-4d8e56b39914 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1760 microversion: 2.1 time: 0.357095 Jun 26 03:14:56.689738 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 527/1025] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:14:56 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1760 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:14:59.657366 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-df281a92-e4af-48e1-97d6-e6df7de7e7ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:59.657972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-df281a92-e4af-48e1-97d6-e6df7de7e7ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:59.664287 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-df281a92-e4af-48e1-97d6-e6df7de7e7ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:59.664747 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-df281a92-e4af-48e1-97d6-e6df7de7e7ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:59.665522 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-df281a92-e4af-48e1-97d6-e6df7de7e7ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:59.665965 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-df281a92-e4af-48e1-97d6-e6df7de7e7ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:59.748527 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-df281a92-e4af-48e1-97d6-e6df7de7e7ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lazy-loading 'services' on Instance uuid c44a3421-d825-4b89-9c4e-8aa8112595d2 {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:14:59.827977 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-df281a92-e4af-48e1-97d6-e6df7de7e7ed tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2/os-volume_attachments/fd54af81-c782-48ae-9199-84371d3e84bd" status: 202 len: 0 microversion: 2.1 time: 0.175755 Jun 26 03:14:59.828522 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 499/1026] 10.222.0.13 () {58 vars in 1415 bytes} [Sun Jun 26 03:14:59 2022] DELETE /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2/os-volume_attachments/fd54af81-c782-48ae-9199-84371d3e84bd => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:14:59.836719 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-eb750b68-1c5e-4d90-9c69-ee6215e82f54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:14:59.837722 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-eb750b68-1c5e-4d90-9c69-ee6215e82f54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:14:59.845281 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-eb750b68-1c5e-4d90-9c69-ee6215e82f54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:59.845744 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-eb750b68-1c5e-4d90-9c69-ee6215e82f54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:59.846790 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-eb750b68-1c5e-4d90-9c69-ee6215e82f54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:14:59.847234 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-eb750b68-1c5e-4d90-9c69-ee6215e82f54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:14:59.879693 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-eb750b68-1c5e-4d90-9c69-ee6215e82f54 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046574 Jun 26 03:14:59.880291 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 528/1027] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:14:59 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:15:00.892873 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2fa4e957-e627-4b9b-b4f2-b275131ca870 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:00.893947 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2fa4e957-e627-4b9b-b4f2-b275131ca870 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:00.900147 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2fa4e957-e627-4b9b-b4f2-b275131ca870 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:00.900606 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2fa4e957-e627-4b9b-b4f2-b275131ca870 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:00.901377 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2fa4e957-e627-4b9b-b4f2-b275131ca870 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:00.901825 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2fa4e957-e627-4b9b-b4f2-b275131ca870 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:00.930540 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2fa4e957-e627-4b9b-b4f2-b275131ca870 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042943 Jun 26 03:15:00.931414 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 500/1028] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:15:00 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 26 03:15:00.993566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-52280c8b-d7f5-447d-9595-a5775a5495c8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:00.994183 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-52280c8b-d7f5-447d-9595-a5775a5495c8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:01.000452 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-52280c8b-d7f5-447d-9595-a5775a5495c8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:01.000904 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-52280c8b-d7f5-447d-9595-a5775a5495c8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:01.001718 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-52280c8b-d7f5-447d-9595-a5775a5495c8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:01.002174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-52280c8b-d7f5-447d-9595-a5775a5495c8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:01.027792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-52280c8b-d7f5-447d-9595-a5775a5495c8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:15:01.117684 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-52280c8b-d7f5-447d-9595-a5775a5495c8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 204 len: 0 microversion: 2.1 time: 0.127397 Jun 26 03:15:01.118347 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 529/1029] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:15:00 2022] DELETE /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:15:01.126543 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-256d01fa-04c5-4e62-9d35-e4abc1ce0a06 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:01.127404 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-256d01fa-04c5-4e62-9d35-e4abc1ce0a06 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:01.133972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-256d01fa-04c5-4e62-9d35-e4abc1ce0a06 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:01.134462 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-256d01fa-04c5-4e62-9d35-e4abc1ce0a06 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:01.135230 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-256d01fa-04c5-4e62-9d35-e4abc1ce0a06 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:01.135665 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-256d01fa-04c5-4e62-9d35-e4abc1ce0a06 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:01.275757 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-256d01fa-04c5-4e62-9d35-e4abc1ce0a06 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:01.283849 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-256d01fa-04c5-4e62-9d35-e4abc1ce0a06 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1681 microversion: 2.1 time: 0.161148 Jun 26 03:15:01.284414 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 501/1030] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:15:01 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:15:02.301444 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-815b2bde-246d-473b-ba53-bf1f44153fc4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:02.302182 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-815b2bde-246d-473b-ba53-bf1f44153fc4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:02.308650 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-815b2bde-246d-473b-ba53-bf1f44153fc4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:02.309112 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-815b2bde-246d-473b-ba53-bf1f44153fc4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:02.309934 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-815b2bde-246d-473b-ba53-bf1f44153fc4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:02.310435 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-815b2bde-246d-473b-ba53-bf1f44153fc4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:02.447610 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-815b2bde-246d-473b-ba53-bf1f44153fc4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:02.455640 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-815b2bde-246d-473b-ba53-bf1f44153fc4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1681 microversion: 2.1 time: 0.158291 Jun 26 03:15:02.456319 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 530/1031] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:15:02 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:15:03.130479 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-89b75864-ff8e-41fc-af66-740ae0505b95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:03.131402 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-89b75864-ff8e-41fc-af66-740ae0505b95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:03.137848 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-89b75864-ff8e-41fc-af66-740ae0505b95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:03.138327 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-89b75864-ff8e-41fc-af66-740ae0505b95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:03.139090 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-89b75864-ff8e-41fc-af66-740ae0505b95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:03.139531 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-89b75864-ff8e-41fc-af66-740ae0505b95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:03.168066 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-89b75864-ff8e-41fc-af66-740ae0505b95 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041724 Jun 26 03:15:03.168613 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 502/1032] 10.222.0.13 () {60 vars in 1342 bytes} [Sun Jun 26 03:15:03 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:15:03.227407 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-89528fb8-5044-4c91-9ca2-31b3176eb4fe tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:03.227912 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-89528fb8-5044-4c91-9ca2-31b3176eb4fe tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:03.234363 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-89528fb8-5044-4c91-9ca2-31b3176eb4fe tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:03.234820 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-89528fb8-5044-4c91-9ca2-31b3176eb4fe tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:03.235586 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-89528fb8-5044-4c91-9ca2-31b3176eb4fe tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:03.236027 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-89528fb8-5044-4c91-9ca2-31b3176eb4fe tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:03.261381 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-89528fb8-5044-4c91-9ca2-31b3176eb4fe tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:15:03.338484 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-89528fb8-5044-4c91-9ca2-31b3176eb4fe tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 204 len: 0 microversion: 2.20 time: 0.114593 Jun 26 03:15:03.339202 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 531/1033] 10.222.0.13 () {60 vars in 1279 bytes} [Sun Jun 26 03:15:03 2022] DELETE /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 26 03:15:03.347660 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-745aa065-9aee-4e69-8f82-3a246b310eba tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:03.348294 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-745aa065-9aee-4e69-8f82-3a246b310eba tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:03.354510 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-745aa065-9aee-4e69-8f82-3a246b310eba tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:03.354977 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-745aa065-9aee-4e69-8f82-3a246b310eba tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:03.355750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-745aa065-9aee-4e69-8f82-3a246b310eba tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:03.356190 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-745aa065-9aee-4e69-8f82-3a246b310eba tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:03.473857 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e4aa9ede-6c3a-49bc-9917-102c82a6ecd8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:03.474598 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e4aa9ede-6c3a-49bc-9917-102c82a6ecd8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:03.482760 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e4aa9ede-6c3a-49bc-9917-102c82a6ecd8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:03.483222 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e4aa9ede-6c3a-49bc-9917-102c82a6ecd8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:03.484002 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e4aa9ede-6c3a-49bc-9917-102c82a6ecd8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:03.484447 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e4aa9ede-6c3a-49bc-9917-102c82a6ecd8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:03.598257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-745aa065-9aee-4e69-8f82-3a246b310eba tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:03.606179 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-745aa065-9aee-4e69-8f82-3a246b310eba tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:03.608233 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-745aa065-9aee-4e69-8f82-3a246b310eba tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:03.609393 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-745aa065-9aee-4e69-8f82-3a246b310eba tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.266098 Jun 26 03:15:03.609982 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 503/1034] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:15:03 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:15:03.714785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e4aa9ede-6c3a-49bc-9917-102c82a6ecd8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:03.722767 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e4aa9ede-6c3a-49bc-9917-102c82a6ecd8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1681 microversion: 2.1 time: 0.253296 Jun 26 03:15:03.723258 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 532/1035] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:15:03 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1681 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:15:04.043910 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-926e9687-b090-4a1e-948c-cf785211e1c5 req-f3de71b1-30c0-46c3-be8d-eb8ba9e4220a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44a3421-d825-4b89-9c4e-8aa8112595d2", "name": "network-vif-deleted", "tag": "ab7ff115-6093-4813-966f-56337f1c2db6"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:15:04.052664 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-926e9687-b090-4a1e-948c-cf785211e1c5 req-f3de71b1-30c0-46c3-be8d-eb8ba9e4220a service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:04.053114 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-926e9687-b090-4a1e-948c-cf785211e1c5 req-f3de71b1-30c0-46c3-be8d-eb8ba9e4220a service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:04.064467 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-926e9687-b090-4a1e-948c-cf785211e1c5 req-f3de71b1-30c0-46c3-be8d-eb8ba9e4220a service nova] Creating event network-vif-deleted:ab7ff115-6093-4813-966f-56337f1c2db6 for instance c44a3421-d825-4b89-9c4e-8aa8112595d2 on hv-cinder-84684 Jun 26 03:15:04.069722 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-926e9687-b090-4a1e-948c-cf785211e1c5 req-f3de71b1-30c0-46c3-be8d-eb8ba9e4220a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029635 Jun 26 03:15:04.070562 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 504/1036] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:15:04.627613 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fd8d06cd-1843-4602-9dba-782ac870bf6d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:04.628851 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fd8d06cd-1843-4602-9dba-782ac870bf6d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:04.636530 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fd8d06cd-1843-4602-9dba-782ac870bf6d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:04.637320 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fd8d06cd-1843-4602-9dba-782ac870bf6d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:04.638882 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fd8d06cd-1843-4602-9dba-782ac870bf6d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:04.639391 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fd8d06cd-1843-4602-9dba-782ac870bf6d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:04.643639 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:04.741808 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-dd0ad9ea-027c-4524-90cd-2a64fd54beba tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:04.742622 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-dd0ad9ea-027c-4524-90cd-2a64fd54beba tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:04.749245 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd0ad9ea-027c-4524-90cd-2a64fd54beba tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:04.749953 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd0ad9ea-027c-4524-90cd-2a64fd54beba tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:04.750966 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd0ad9ea-027c-4524-90cd-2a64fd54beba tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:04.751560 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd0ad9ea-027c-4524-90cd-2a64fd54beba tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:04.786256 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fd8d06cd-1843-4602-9dba-782ac870bf6d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:04.791974 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd0ad9ea-027c-4524-90cd-2a64fd54beba tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:04.792664 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-dd0ad9ea-027c-4524-90cd-2a64fd54beba tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:04.793399 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-dd0ad9ea-027c-4524-90cd-2a64fd54beba tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lazy-loading 'fault' on Instance uuid c44a3421-d825-4b89-9c4e-8aa8112595d2 {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:15:04.795843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fd8d06cd-1843-4602-9dba-782ac870bf6d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:04.797555 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fd8d06cd-1843-4602-9dba-782ac870bf6d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:04.798892 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fd8d06cd-1843-4602-9dba-782ac870bf6d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.175211 Jun 26 03:15:04.799525 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 533/1037] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:15:04 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:15:04.861639 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-dd0ad9ea-027c-4524-90cd-2a64fd54beba tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:04.871650 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-dd0ad9ea-027c-4524-90cd-2a64fd54beba tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1331 microversion: 2.1 time: 0.134533 Jun 26 03:15:04.873182 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 505/1038] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:15:04 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1331 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:15:05.817487 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4d7fb0bb-2d47-41d5-a225-bb6e48df8567 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:05.818143 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4d7fb0bb-2d47-41d5-a225-bb6e48df8567 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:05.824700 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d7fb0bb-2d47-41d5-a225-bb6e48df8567 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:05.825149 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d7fb0bb-2d47-41d5-a225-bb6e48df8567 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:05.826539 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d7fb0bb-2d47-41d5-a225-bb6e48df8567 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:05.826976 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d7fb0bb-2d47-41d5-a225-bb6e48df8567 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:05.890719 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1faba90c-7351-4098-8208-aa1ecfd07d14 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:05.891326 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1faba90c-7351-4098-8208-aa1ecfd07d14 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:05.897689 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1faba90c-7351-4098-8208-aa1ecfd07d14 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:05.898171 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1faba90c-7351-4098-8208-aa1ecfd07d14 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:05.899090 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1faba90c-7351-4098-8208-aa1ecfd07d14 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:05.899534 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1faba90c-7351-4098-8208-aa1ecfd07d14 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:05.931242 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1faba90c-7351-4098-8208-aa1ecfd07d14 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:05.931698 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1faba90c-7351-4098-8208-aa1ecfd07d14 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:05.932156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-1faba90c-7351-4098-8208-aa1ecfd07d14 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lazy-loading 'fault' on Instance uuid c44a3421-d825-4b89-9c4e-8aa8112595d2 {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:15:05.965906 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4d7fb0bb-2d47-41d5-a225-bb6e48df8567 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:05.973696 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4d7fb0bb-2d47-41d5-a225-bb6e48df8567 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:05.975206 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4d7fb0bb-2d47-41d5-a225-bb6e48df8567 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:05.976352 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4d7fb0bb-2d47-41d5-a225-bb6e48df8567 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.162691 Jun 26 03:15:05.976911 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 534/1039] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:15:05 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:15:05.981511 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1faba90c-7351-4098-8208-aa1ecfd07d14 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:05.988972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1faba90c-7351-4098-8208-aa1ecfd07d14 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1331 microversion: 2.1 time: 0.102943 Jun 26 03:15:05.989514 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 506/1040] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:15:05 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:15:06.993898 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a160891f-1d95-411b-8488-ef4a74852ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:06.994455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a160891f-1d95-411b-8488-ef4a74852ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:07.000944 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a160891f-1d95-411b-8488-ef4a74852ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:07.001396 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a160891f-1d95-411b-8488-ef4a74852ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:07.002194 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a160891f-1d95-411b-8488-ef4a74852ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:07.002633 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a160891f-1d95-411b-8488-ef4a74852ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:07.005499 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-01c73246-2aad-45b6-918c-b54f06961cd9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:07.006274 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-01c73246-2aad-45b6-918c-b54f06961cd9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:07.013144 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-01c73246-2aad-45b6-918c-b54f06961cd9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:07.013604 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-01c73246-2aad-45b6-918c-b54f06961cd9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:07.014410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-01c73246-2aad-45b6-918c-b54f06961cd9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:07.014856 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-01c73246-2aad-45b6-918c-b54f06961cd9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:07.045684 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-01c73246-2aad-45b6-918c-b54f06961cd9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:07.046193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-01c73246-2aad-45b6-918c-b54f06961cd9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:07.046660 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-01c73246-2aad-45b6-918c-b54f06961cd9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lazy-loading 'fault' on Instance uuid c44a3421-d825-4b89-9c4e-8aa8112595d2 {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:15:07.348350 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-01c73246-2aad-45b6-918c-b54f06961cd9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:07.356091 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-01c73246-2aad-45b6-918c-b54f06961cd9 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1331 microversion: 2.1 time: 0.354613 Jun 26 03:15:07.356657 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 507/1041] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:15:07 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1331 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:15:07.405551 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a160891f-1d95-411b-8488-ef4a74852ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:07.413682 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a160891f-1d95-411b-8488-ef4a74852ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:07.415220 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a160891f-1d95-411b-8488-ef4a74852ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:07.416375 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a160891f-1d95-411b-8488-ef4a74852ad9 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.426447 Jun 26 03:15:07.416920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 535/1042] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:15:06 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:15:08.372718 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-57fc902c-8a79-40b5-8ad7-8bd71e9aeaeb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:08.373329 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-57fc902c-8a79-40b5-8ad7-8bd71e9aeaeb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:08.380148 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-57fc902c-8a79-40b5-8ad7-8bd71e9aeaeb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:08.380598 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-57fc902c-8a79-40b5-8ad7-8bd71e9aeaeb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:08.381363 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-57fc902c-8a79-40b5-8ad7-8bd71e9aeaeb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:08.381800 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-57fc902c-8a79-40b5-8ad7-8bd71e9aeaeb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:08.412177 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-57fc902c-8a79-40b5-8ad7-8bd71e9aeaeb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:08.412628 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-57fc902c-8a79-40b5-8ad7-8bd71e9aeaeb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:08.413075 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.objects.instance [None req-57fc902c-8a79-40b5-8ad7-8bd71e9aeaeb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lazy-loading 'fault' on Instance uuid c44a3421-d825-4b89-9c4e-8aa8112595d2 {{(pid=117782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:15:08.437069 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-bef701dc-6a8b-45ef-9b1f-f18553df4221 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:08.437069 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-bef701dc-6a8b-45ef-9b1f-f18553df4221 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:08.441905 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bef701dc-6a8b-45ef-9b1f-f18553df4221 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:08.442397 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bef701dc-6a8b-45ef-9b1f-f18553df4221 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:08.443164 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bef701dc-6a8b-45ef-9b1f-f18553df4221 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:08.443597 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bef701dc-6a8b-45ef-9b1f-f18553df4221 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:08.453368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-57fc902c-8a79-40b5-8ad7-8bd71e9aeaeb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a90ca5e374fc882b644e34e0a3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1850f9f425294a82add8a09690dc1df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:08.460804 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-57fc902c-8a79-40b5-8ad7-8bd71e9aeaeb tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 200 len: 1331 microversion: 2.1 time: 0.092035 Jun 26 03:15:08.461606 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 508/1043] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:15:08 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:15:08.568352 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bef701dc-6a8b-45ef-9b1f-f18553df4221 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:08.576756 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bef701dc-6a8b-45ef-9b1f-f18553df4221 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:08.578352 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bef701dc-6a8b-45ef-9b1f-f18553df4221 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:08.579493 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-bef701dc-6a8b-45ef-9b1f-f18553df4221 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1725 microversion: 2.20 time: 0.148500 Jun 26 03:15:08.580042 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 536/1044] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:15:08 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 26 03:15:09.478997 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2e82d4d6-c18a-42d8-84ab-d9771c65aa2a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:09.479788 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2e82d4d6-c18a-42d8-84ab-d9771c65aa2a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:09.487075 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2e82d4d6-c18a-42d8-84ab-d9771c65aa2a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:09.487769 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2e82d4d6-c18a-42d8-84ab-d9771c65aa2a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:09.488733 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2e82d4d6-c18a-42d8-84ab-d9771c65aa2a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:09.489181 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2e82d4d6-c18a-42d8-84ab-d9771c65aa2a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:09.504928 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-2e82d4d6-c18a-42d8-84ab-d9771c65aa2a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2e82d4d6-c18a-42d8-84ab-d9771c65aa2a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 HTTP/1.1 Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:15:09.506720 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:15:09.508172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:15:09.508172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:09.508172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:09.508172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:09.508172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:09.508172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:15:09.508172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:15:09.508172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:15:09.508172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:09.508172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:15:09.508172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:09.508172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': 'c44a3421-d825-4b89-9c4e-8aa8112595d2'} Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:09.508975 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:09.510345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:09.511492 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2e82d4d6-c18a-42d8-84ab-d9771c65aa2a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 404 to user: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:09.511492 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2e82d4d6-c18a-42d8-84ab-d9771c65aa2a tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 404 len: 111 microversion: 2.1 time: 0.034037 Jun 26 03:15:09.511492 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 509/1045] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:15:09 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:15:09.516867 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8eec1401-883f-46fd-90d9-d75056932fc3 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '.version_select at 0x7f5827780040>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:09.537881 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8eec1401-883f-46fd-90d9-d75056932fc3 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-390176419" status: 202 len: 0 microversion: 2.1 time: 0.024121 Jun 26 03:15:09.538871 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 537/1046] 10.222.0.13 () {58 vars in 1217 bytes} [Sun Jun 26 03:15:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-390176419 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:15:09.598592 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-10d75d8a-93f8-4f71-8c5d-1a85a454f69b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:09.599483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-10d75d8a-93f8-4f71-8c5d-1a85a454f69b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:09.632718 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10d75d8a-93f8-4f71-8c5d-1a85a454f69b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:09.633787 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10d75d8a-93f8-4f71-8c5d-1a85a454f69b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:09.634832 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10d75d8a-93f8-4f71-8c5d-1a85a454f69b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:09.636436 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-10d75d8a-93f8-4f71-8c5d-1a85a454f69b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:09.672400 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-b337b6ef-fd60-49ae-b7c4-07c5bcb3b80a req-9c249335-cd42-4718-9df6-1400017b079d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee71e3f2-a415-4000-97d4-290a4675ee4e", "name": "network-vif-deleted", "tag": "7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:15:09.686572 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-b337b6ef-fd60-49ae-b7c4-07c5bcb3b80a req-9c249335-cd42-4718-9df6-1400017b079d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:09.687651 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-b337b6ef-fd60-49ae-b7c4-07c5bcb3b80a req-9c249335-cd42-4718-9df6-1400017b079d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:09.700674 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-b337b6ef-fd60-49ae-b7c4-07c5bcb3b80a req-9c249335-cd42-4718-9df6-1400017b079d service nova] Creating event network-vif-deleted:7dd1c0b3-ac2d-47eb-81cd-5f0cd845e6c6 for instance ee71e3f2-a415-4000-97d4-290a4675ee4e on hv-cinder-84684 Jun 26 03:15:09.706310 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-b337b6ef-fd60-49ae-b7c4-07c5bcb3b80a req-9c249335-cd42-4718-9df6-1400017b079d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038160 Jun 26 03:15:09.707798 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 538/1047] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:15:09.797571 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-10d75d8a-93f8-4f71-8c5d-1a85a454f69b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:09.807890 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-10d75d8a-93f8-4f71-8c5d-1a85a454f69b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:09.810666 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-10d75d8a-93f8-4f71-8c5d-1a85a454f69b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '430d2efc691e4aae9f96409b081c7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dd1a7a651fa4d27a1b6488ca13effca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:15:09.811856 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-10d75d8a-93f8-4f71-8c5d-1a85a454f69b tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 200 len: 1657 microversion: 2.20 time: 0.218427 Jun 26 03:15:09.818094 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 510/1048] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:15:09 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 1657 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 26 03:15:10.833049 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-92ef7856-97a1-43b0-a2eb-e427dd547d21 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:10.833669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-92ef7856-97a1-43b0-a2eb-e427dd547d21 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:10.840033 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-92ef7856-97a1-43b0-a2eb-e427dd547d21 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:10.840495 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-92ef7856-97a1-43b0-a2eb-e427dd547d21 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:10.841845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-92ef7856-97a1-43b0-a2eb-e427dd547d21 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:10.842319 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-92ef7856-97a1-43b0-a2eb-e427dd547d21 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:10.856402 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-92ef7856-97a1-43b0-a2eb-e427dd547d21 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] HTTP exception thrown: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-92ef7856-97a1-43b0-a2eb-e427dd547d21 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Request method failure captured: Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e HTTP/1.1 Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zKxIvYpxH8cnnfUpzhJ4qrsLEzUUvvIeoHIzze08rDvffyk_6UnMMVldyhnF1WcrcYaqru1vuEypebS29viyK0F3RALZSFYPrqhbldVqfvm9AaAuQswi7MW56GHyQa7vlCkwmOpJg2k1Qt2D7xxpff9vELYIOqKNDsEcSe_B0amHM Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Openstack-Nova-Api-Version: 2.20 Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 5dd1a7a651fa4d27a1b6488ca13effca Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:15:10.858158 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:15:10.859678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5dd1a7a651fa4d27a1b6488ca13effca"}]}] Jun 26 03:15:10.859678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:10.859678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 5dd1a7a651fa4d27a1b6488ca13effca Jun 26 03:15:10.859678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:10.859678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-AttachVolumeShelveTestJSON-930384486-project Jun 26 03:15:10.859678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:15:10.859678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:15:10.859678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 430d2efc691e4aae9f96409b081c7e96 Jun 26 03:15:10.859678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-AttachVolumeShelveTestJSON-930384486-project Jun 26 03:15:10.859678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:15:10.859678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:10.859678 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': 'ee71e3f2-a415-4000-97d4-290a4675ee4e'} Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:10.860485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:10.861792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:10.862883 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-92ef7856-97a1-43b0-a2eb-e427dd547d21 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Returning 404 to user: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:10.862883 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-92ef7856-97a1-43b0-a2eb-e427dd547d21 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 404 len: 111 microversion: 2.20 time: 0.031500 Jun 26 03:15:10.862883 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 539/1049] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:15:10 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 26 03:15:10.868651 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2b4b0e52-19bd-4dfb-b895-b57e7c620eb7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '.version_select at 0x7f5827594160>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:10.891424 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2b4b0e52-19bd-4dfb-b895-b57e7c620eb7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1256657685" status: 204 len: 0 microversion: 2.20 time: 0.026465 Jun 26 03:15:10.892025 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 511/1050] 10.222.0.13 () {60 vars in 1261 bytes} [Sun Jun 26 03:15:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1256657685 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 26 03:15:11.705853 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d465115b-a1f5-42d5-b981-05c9f4e043d2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:11.706382 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d465115b-a1f5-42d5-b981-05c9f4e043d2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:11.712384 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d465115b-a1f5-42d5-b981-05c9f4e043d2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:11.712842 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d465115b-a1f5-42d5-b981-05c9f4e043d2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:11.713661 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d465115b-a1f5-42d5-b981-05c9f4e043d2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:11.714240 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d465115b-a1f5-42d5-b981-05c9f4e043d2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:11.727732 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-d465115b-a1f5-42d5-b981-05c9f4e043d2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d465115b-a1f5-42d5-b981-05c9f4e043d2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: DELETE /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 HTTP/1.1 Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:15:11.729272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:15:11.730920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:15:11.730920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:11.730920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:11.730920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:11.730920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:11.730920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:15:11.730920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:15:11.730920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:15:11.730920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:11.730920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:15:11.730920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:11.730920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': 'c44a3421-d825-4b89-9c4e-8aa8112595d2'} Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:11.732307 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:11.733523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:11.734813 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d465115b-a1f5-42d5-b981-05c9f4e043d2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 404 to user: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:11.734813 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d465115b-a1f5-42d5-b981-05c9f4e043d2 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 404 len: 111 microversion: 2.1 time: 0.028600 Jun 26 03:15:11.734813 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 540/1051] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:15:11 2022] DELETE /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:15:11.739513 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7598cbf9-70fe-4383-9cc0-7876ece4f50d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:11.740128 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7598cbf9-70fe-4383-9cc0-7876ece4f50d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: c44a3421-d825-4b89-9c4e-8aa8112595d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:11.746006 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7598cbf9-70fe-4383-9cc0-7876ece4f50d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:11.746491 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7598cbf9-70fe-4383-9cc0-7876ece4f50d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:11.747284 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7598cbf9-70fe-4383-9cc0-7876ece4f50d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:11.747721 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7598cbf9-70fe-4383-9cc0-7876ece4f50d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:11.761255 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-7598cbf9-70fe-4383-9cc0-7876ece4f50d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7598cbf9-70fe-4383-9cc0-7876ece4f50d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 HTTP/1.1 Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:15:11.762933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:15:11.764524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:15:11.764524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:11.764524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:11.764524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:11.764524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:11.764524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:15:11.764524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:15:11.764524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:15:11.764524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:11.764524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:15:11.764524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:11.764524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': 'c44a3421-d825-4b89-9c4e-8aa8112595d2'} Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:11.765447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. Jun 26 03:15:11.766976 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:11.768262 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7598cbf9-70fe-4383-9cc0-7876ece4f50d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 404 to user: Instance c44a3421-d825-4b89-9c4e-8aa8112595d2 could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:11.768262 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-7598cbf9-70fe-4383-9cc0-7876ece4f50d tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2" status: 404 len: 111 microversion: 2.1 time: 0.028646 Jun 26 03:15:11.768262 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 512/1052] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:15:11 2022] GET /compute/v2.1/servers/c44a3421-d825-4b89-9c4e-8aa8112595d2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:15:12.655789 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-77ba2ee6-4cdb-4201-9b78-f0407b94fde2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:12.656174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-77ba2ee6-4cdb-4201-9b78-f0407b94fde2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:12.662847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-77ba2ee6-4cdb-4201-9b78-f0407b94fde2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:12.663501 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-77ba2ee6-4cdb-4201-9b78-f0407b94fde2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:12.664447 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-77ba2ee6-4cdb-4201-9b78-f0407b94fde2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:12.665038 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-77ba2ee6-4cdb-4201-9b78-f0407b94fde2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:12.680487 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-77ba2ee6-4cdb-4201-9b78-f0407b94fde2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] HTTP exception thrown: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-77ba2ee6-4cdb-4201-9b78-f0407b94fde2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Request method failure captured: Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: DELETE /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e HTTP/1.1 Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zKxIvYpxH8cnnfUpzhJ4qrsLEzUUvvIeoHIzze08rDvffyk_6UnMMVldyhnF1WcrcYaqru1vuEypebS29viyK0F3RALZSFYPrqhbldVqfvm9AaAuQswi7MW56GHyQa7vlCkwmOpJg2k1Qt2D7xxpff9vELYIOqKNDsEcSe_B0amHM Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Openstack-Nova-Api-Version: 2.20 Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 5dd1a7a651fa4d27a1b6488ca13effca Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:15:12.682246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:15:12.683847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5dd1a7a651fa4d27a1b6488ca13effca"}]}] Jun 26 03:15:12.683847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:12.683847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 5dd1a7a651fa4d27a1b6488ca13effca Jun 26 03:15:12.683847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:12.683847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-AttachVolumeShelveTestJSON-930384486-project Jun 26 03:15:12.683847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:15:12.683847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:15:12.683847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 430d2efc691e4aae9f96409b081c7e96 Jun 26 03:15:12.683847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-AttachVolumeShelveTestJSON-930384486-project Jun 26 03:15:12.683847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:15:12.683847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:12.683847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': 'ee71e3f2-a415-4000-97d4-290a4675ee4e'} Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:12.685292 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:12.686550 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.688808 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-77ba2ee6-4cdb-4201-9b78-f0407b94fde2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Returning 404 to user: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:12.688808 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-77ba2ee6-4cdb-4201-9b78-f0407b94fde2 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 404 len: 111 microversion: 2.20 time: 0.032171 Jun 26 03:15:12.688808 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 541/1053] 10.222.0.13 () {60 vars in 1279 bytes} [Sun Jun 26 03:15:12 2022] DELETE /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 26 03:15:12.692655 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-667f93b7-07ca-44e3-b34e-a3773617119f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:12.693264 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-667f93b7-07ca-44e3-b34e-a3773617119f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: ee71e3f2-a415-4000-97d4-290a4675ee4e] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:12.699603 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-667f93b7-07ca-44e3-b34e-a3773617119f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:12.700056 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-667f93b7-07ca-44e3-b34e-a3773617119f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:12.701493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-667f93b7-07ca-44e3-b34e-a3773617119f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:12.701931 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-667f93b7-07ca-44e3-b34e-a3773617119f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:12.716804 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-667f93b7-07ca-44e3-b34e-a3773617119f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] HTTP exception thrown: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-667f93b7-07ca-44e3-b34e-a3773617119f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Request method failure captured: Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e HTTP/1.1 Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zKxIvYpxH8cnnfUpzhJ4qrsLEzUUvvIeoHIzze08rDvffyk_6UnMMVldyhnF1WcrcYaqru1vuEypebS29viyK0F3RALZSFYPrqhbldVqfvm9AaAuQswi7MW56GHyQa7vlCkwmOpJg2k1Qt2D7xxpff9vELYIOqKNDsEcSe_B0amHM Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Openstack-Nova-Api-Version: 2.20 Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 5dd1a7a651fa4d27a1b6488ca13effca Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:15:12.718601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:15:12.720351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5dd1a7a651fa4d27a1b6488ca13effca"}]}] Jun 26 03:15:12.720351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:12.720351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 5dd1a7a651fa4d27a1b6488ca13effca Jun 26 03:15:12.720351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:12.720351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeShelveTestJSON-930384486-project Jun 26 03:15:12.720351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:15:12.720351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:15:12.720351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 430d2efc691e4aae9f96409b081c7e96 Jun 26 03:15:12.720351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeShelveTestJSON-930384486-project Jun 26 03:15:12.720351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:15:12.720351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:12.720351 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': 'ee71e3f2-a415-4000-97d4-290a4675ee4e'} Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:12.721257 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. Jun 26 03:15:12.722792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.724515 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-667f93b7-07ca-44e3-b34e-a3773617119f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Returning 404 to user: Instance ee71e3f2-a415-4000-97d4-290a4675ee4e could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:12.724515 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-667f93b7-07ca-44e3-b34e-a3773617119f tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e" status: 404 len: 111 microversion: 2.20 time: 0.031157 Jun 26 03:15:12.724515 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 513/1054] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:15:12 2022] GET /compute/v2.1/servers/ee71e3f2-a415-4000-97d4-290a4675ee4e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 26 03:15:12.898983 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-081a39fa-b047-4edf-aed9-81096cb72dd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:12.899575 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-081a39fa-b047-4edf-aed9-81096cb72dd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:12.905531 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-081a39fa-b047-4edf-aed9-81096cb72dd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:12.905991 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-081a39fa-b047-4edf-aed9-81096cb72dd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:12.906798 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-081a39fa-b047-4edf-aed9-81096cb72dd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:12.907245 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-081a39fa-b047-4edf-aed9-81096cb72dd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:12.921193 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-081a39fa-b047-4edf-aed9-81096cb72dd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-081a39fa-b047-4edf-aed9-81096cb72dd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: DELETE /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 HTTP/1.1 Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:15:12.922785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:15:12.924189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:15:12.924189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:12.924189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:12.924189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:12.924189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:12.924189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:15:12.924189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:15:12.924189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:15:12.924189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:12.924189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:15:12.924189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:15:12.924189 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '16b07d92-79ab-4155-972b-7619661bd1d2'} Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:12.925092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:15:12.926819 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.928408 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-081a39fa-b047-4edf-aed9-81096cb72dd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 404 to user: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:12.928408 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-081a39fa-b047-4edf-aed9-81096cb72dd4 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 404 len: 111 microversion: 2.1 time: 0.029035 Jun 26 03:15:12.928408 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 542/1055] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:15:12 2022] DELETE /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:15:12.932609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-04e1204a-6f59-4538-ac4e-39bfc448468c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:12.933230 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-04e1204a-6f59-4538-ac4e-39bfc448468c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 16b07d92-79ab-4155-972b-7619661bd1d2] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:12.939884 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-04e1204a-6f59-4538-ac4e-39bfc448468c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:12.940341 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-04e1204a-6f59-4538-ac4e-39bfc448468c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:12.941240 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-04e1204a-6f59-4538-ac4e-39bfc448468c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:12.941684 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-04e1204a-6f59-4538-ac4e-39bfc448468c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:12.956718 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-04e1204a-6f59-4538-ac4e-39bfc448468c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-04e1204a-6f59-4538-ac4e-39bfc448468c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 HTTP/1.1 Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:15:12.958535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:15:12.959988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:15:12.959988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:12.959988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:12.959988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:12.959988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:12.959988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:15:12.959988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:15:12.959988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:15:12.959988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:12.959988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:15:12.959988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:15:12.959988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '16b07d92-79ab-4155-972b-7619661bd1d2'} Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:12.960881 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. Jun 26 03:15:12.962369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.963597 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-04e1204a-6f59-4538-ac4e-39bfc448468c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 404 to user: Instance 16b07d92-79ab-4155-972b-7619661bd1d2 could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:12.963597 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-04e1204a-6f59-4538-ac4e-39bfc448468c tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2" status: 404 len: 111 microversion: 2.1 time: 0.031322 Jun 26 03:15:12.963597 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 514/1056] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:15:12 2022] GET /compute/v2.1/servers/16b07d92-79ab-4155-972b-7619661bd1d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:15:12.969482 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-72a617ed-8fd8-4873-85cd-3fc9b0eb7c62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:12.970002 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-72a617ed-8fd8-4873-85cd-3fc9b0eb7c62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:12.976089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-72a617ed-8fd8-4873-85cd-3fc9b0eb7c62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:12.976557 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-72a617ed-8fd8-4873-85cd-3fc9b0eb7c62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:12.977336 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-72a617ed-8fd8-4873-85cd-3fc9b0eb7c62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:12.977963 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-72a617ed-8fd8-4873-85cd-3fc9b0eb7c62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:12.992208 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-72a617ed-8fd8-4873-85cd-3fc9b0eb7c62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-72a617ed-8fd8-4873-85cd-3fc9b0eb7c62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: DELETE /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 HTTP/1.1 Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:15:12.993769 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:15:12.995377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:15:12.995377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:12.995377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:12.995377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:12.995377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:12.995377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:15:12.995377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:15:12.995377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:15:12.995377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:12.995377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:15:12.995377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:15:12.995377 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '3c4e7b87-db95-47e8-8679-3a36a89d75f7'} Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:12.996485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:15:12.998609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.000379 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-72a617ed-8fd8-4873-85cd-3fc9b0eb7c62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 404 to user: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:13.000379 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-72a617ed-8fd8-4873-85cd-3fc9b0eb7c62 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 404 len: 111 microversion: 2.1 time: 0.029917 Jun 26 03:15:13.000379 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 543/1057] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:15:12 2022] DELETE /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:15:13.004731 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-02f12aa8-6cb7-4c6e-a97b-7149fdbf71ae tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:13.005378 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-02f12aa8-6cb7-4c6e-a97b-7149fdbf71ae tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: 3c4e7b87-db95-47e8-8679-3a36a89d75f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:13.011814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-02f12aa8-6cb7-4c6e-a97b-7149fdbf71ae tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:13.012264 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-02f12aa8-6cb7-4c6e-a97b-7149fdbf71ae tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:13.013069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-02f12aa8-6cb7-4c6e-a97b-7149fdbf71ae tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:13.013525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-02f12aa8-6cb7-4c6e-a97b-7149fdbf71ae tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:13.027413 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-02f12aa8-6cb7-4c6e-a97b-7149fdbf71ae tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-02f12aa8-6cb7-4c6e-a97b-7149fdbf71ae tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 HTTP/1.1 Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:15:13.028989 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:15:13.030711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:15:13.030711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:13.030711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:13.030711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:13.030711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:13.030711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:15:13.030711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:15:13.030711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:15:13.030711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:13.030711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:15:13.030711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:15:13.030711 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '3c4e7b87-db95-47e8-8679-3a36a89d75f7'} Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:13.031648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. Jun 26 03:15:13.033110 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.034569 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-02f12aa8-6cb7-4c6e-a97b-7149fdbf71ae tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 404 to user: Instance 3c4e7b87-db95-47e8-8679-3a36a89d75f7 could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:13.034569 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-02f12aa8-6cb7-4c6e-a97b-7149fdbf71ae tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7" status: 404 len: 111 microversion: 2.1 time: 0.029794 Jun 26 03:15:13.034569 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 515/1058] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:15:12 2022] GET /compute/v2.1/servers/3c4e7b87-db95-47e8-8679-3a36a89d75f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:15:13.859129 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9c0308cb-49c9-44de-b5fe-ade2655125b7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:13.859644 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9c0308cb-49c9-44de-b5fe-ade2655125b7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:13.868913 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9c0308cb-49c9-44de-b5fe-ade2655125b7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:13.868913 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9c0308cb-49c9-44de-b5fe-ade2655125b7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:13.868913 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9c0308cb-49c9-44de-b5fe-ade2655125b7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:13.868913 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9c0308cb-49c9-44de-b5fe-ade2655125b7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:13.883117 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-9c0308cb-49c9-44de-b5fe-ade2655125b7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] HTTP exception thrown: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9c0308cb-49c9-44de-b5fe-ade2655125b7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Request method failure captured: Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: DELETE /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 HTTP/1.1 Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zKxIvYpxH8cnnfUpzhJ4qrsLEzUUvvIeoHIzze08rDvffyk_6UnMMVldyhnF1WcrcYaqru1vuEypebS29viyK0F3RALZSFYPrqhbldVqfvm9AaAuQswi7MW56GHyQa7vlCkwmOpJg2k1Qt2D7xxpff9vELYIOqKNDsEcSe_B0amHM Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Openstack-Nova-Api-Version: 2.20 Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 5dd1a7a651fa4d27a1b6488ca13effca Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:15:13.884726 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:15:13.886272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5dd1a7a651fa4d27a1b6488ca13effca"}]}] Jun 26 03:15:13.886272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:13.886272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 5dd1a7a651fa4d27a1b6488ca13effca Jun 26 03:15:13.886272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:13.886272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-AttachVolumeShelveTestJSON-930384486-project Jun 26 03:15:13.886272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:15:13.886272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:15:13.886272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 430d2efc691e4aae9f96409b081c7e96 Jun 26 03:15:13.886272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-AttachVolumeShelveTestJSON-930384486-project Jun 26 03:15:13.886272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:15:13.886272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:15:13.886272 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '3b0d1d9b-d025-442c-a2f6-db22050d9059'} Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:13.887011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:15:13.888754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.889948 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9c0308cb-49c9-44de-b5fe-ade2655125b7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Returning 404 to user: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:13.889948 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9c0308cb-49c9-44de-b5fe-ade2655125b7 tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 404 len: 111 microversion: 2.20 time: 0.030981 Jun 26 03:15:13.889948 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 544/1059] 10.222.0.13 () {60 vars in 1279 bytes} [Sun Jun 26 03:15:13 2022] DELETE /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 26 03:15:13.895633 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-66e470ea-c992-4d28-964b-642165aa2b9d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:13.896292 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-66e470ea-c992-4d28-964b-642165aa2b9d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] [instance: 3b0d1d9b-d025-442c-a2f6-db22050d9059] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:13.904044 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-66e470ea-c992-4d28-964b-642165aa2b9d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:13.904505 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-66e470ea-c992-4d28-964b-642165aa2b9d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:13.905287 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-66e470ea-c992-4d28-964b-642165aa2b9d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:13.905729 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-66e470ea-c992-4d28-964b-642165aa2b9d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:13.922301 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-66e470ea-c992-4d28-964b-642165aa2b9d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] HTTP exception thrown: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-66e470ea-c992-4d28-964b-642165aa2b9d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Request method failure captured: Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 HTTP/1.1 Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zKxIvYpxH8cnnfUpzhJ4qrsLEzUUvvIeoHIzze08rDvffyk_6UnMMVldyhnF1WcrcYaqru1vuEypebS29viyK0F3RALZSFYPrqhbldVqfvm9AaAuQswi7MW56GHyQa7vlCkwmOpJg2k1Qt2D7xxpff9vELYIOqKNDsEcSe_B0amHM Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Openstack-Nova-Api-Version: 2.20 Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 5dd1a7a651fa4d27a1b6488ca13effca Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:15:13.923869 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:15:13.925796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5dd1a7a651fa4d27a1b6488ca13effca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5dd1a7a651fa4d27a1b6488ca13effca"}]}] Jun 26 03:15:13.925796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:13.925796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 5dd1a7a651fa4d27a1b6488ca13effca Jun 26 03:15:13.925796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-930384486 Jun 26 03:15:13.925796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeShelveTestJSON-930384486-project Jun 26 03:15:13.925796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:15:13.925796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:15:13.925796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 430d2efc691e4aae9f96409b081c7e96 Jun 26 03:15:13.925796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeShelveTestJSON-930384486-project Jun 26 03:15:13.925796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:15:13.925796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:15:13.925796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '3b0d1d9b-d025-442c-a2f6-db22050d9059'} Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:13.926611 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. Jun 26 03:15:13.927797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:13.928910 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-66e470ea-c992-4d28-964b-642165aa2b9d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] Returning 404 to user: Instance 3b0d1d9b-d025-442c-a2f6-db22050d9059 could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:13.928910 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-66e470ea-c992-4d28-964b-642165aa2b9d tempest-AttachVolumeShelveTestJSON-930384486 tempest-AttachVolumeShelveTestJSON-930384486-project] 10.222.0.13 "GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059" status: 404 len: 111 microversion: 2.20 time: 0.033772 Jun 26 03:15:13.928910 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 516/1060] 10.222.0.13 () {60 vars in 1276 bytes} [Sun Jun 26 03:15:13 2022] GET /compute/v2.1/servers/3b0d1d9b-d025-442c-a2f6-db22050d9059 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 26 03:15:14.172486 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-363e5744-8911-458a-892a-c4ef6abfd8ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:14.173063 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-363e5744-8911-458a-892a-c4ef6abfd8ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:14.179174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-363e5744-8911-458a-892a-c4ef6abfd8ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:14.179885 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-363e5744-8911-458a-892a-c4ef6abfd8ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:14.180659 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-363e5744-8911-458a-892a-c4ef6abfd8ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:14.181097 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-363e5744-8911-458a-892a-c4ef6abfd8ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:14.194781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-363e5744-8911-458a-892a-c4ef6abfd8ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-363e5744-8911-458a-892a-c4ef6abfd8ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: DELETE /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab HTTP/1.1 Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:15:14.196430 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:15:14.198210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:15:14.198210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:14.198210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:14.198210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:14.198210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:14.198210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:15:14.198210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:15:14.198210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:15:14.198210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:14.198210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:15:14.198210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:15:14.198210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': 'd87611df-64cb-42cb-b734-782bf9ebb9ab'} Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:14.198982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:15:14.200237 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:15:14.202271 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-363e5744-8911-458a-892a-c4ef6abfd8ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 404 to user: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:14.202271 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-363e5744-8911-458a-892a-c4ef6abfd8ea tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 404 len: 111 microversion: 2.1 time: 0.029242 Jun 26 03:15:14.202271 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 545/1061] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:15:14 2022] DELETE /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:15:14.207172 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-232cb172-0545-49e5-b672-78e0cb683ab8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:15:14.207785 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-232cb172-0545-49e5-b672-78e0cb683ab8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] [instance: d87611df-64cb-42cb-b734-782bf9ebb9ab] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:15:14.214113 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-232cb172-0545-49e5-b672-78e0cb683ab8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:14.214566 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-232cb172-0545-49e5-b672-78e0cb683ab8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:14.215359 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-232cb172-0545-49e5-b672-78e0cb683ab8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:15:14.215797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-232cb172-0545-49e5-b672-78e0cb683ab8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:15:14.230343 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-232cb172-0545-49e5-b672-78e0cb683ab8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] HTTP exception thrown: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-232cb172-0545-49e5-b672-78e0cb683ab8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Request method failure captured: Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab HTTP/1.1 Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit8zTWfBEsx9KDBRhCCZoVE-hGfnc3VLmEWRMouB-jN42epBiOLuQ85hfxOBkDf0Z9RB7zy3VZJ6PadxOb7oM4K9eQ6QUGotGweMzZOO6mHmmHckDEK3ka_4m-PrvdR_QAUrmNqWD21K7pIxQTO5I1kXKrn_720cb16-CvzYmD46-U68 Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:15:14.231867 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:15:14.233493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1850f9f425294a82add8a09690dc1df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1850f9f425294a82add8a09690dc1df0"}]}] Jun 26 03:15:14.233493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:14.233493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 1850f9f425294a82add8a09690dc1df0 Jun 26 03:15:14.233493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-953895353 Jun 26 03:15:14.233493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:14.233493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:15:14.233493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:15:14.233493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 3b7a90ca5e374fc882b644e34e0a3015 Jun 26 03:15:14.233493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-AttachVolumeNegativeTest-953895353-project Jun 26 03:15:14.233493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:15:14.233493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:15:14.233493 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': 'd87611df-64cb-42cb-b734-782bf9ebb9ab'} Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:15:14.234782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. Jun 26 03:15:14.236039 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:15:14.237773 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-232cb172-0545-49e5-b672-78e0cb683ab8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] Returning 404 to user: Instance d87611df-64cb-42cb-b734-782bf9ebb9ab could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:15:14.237773 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-232cb172-0545-49e5-b672-78e0cb683ab8 tempest-AttachVolumeNegativeTest-953895353 tempest-AttachVolumeNegativeTest-953895353-project] 10.222.0.13 "GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab" status: 404 len: 111 microversion: 2.1 time: 0.029783 Jun 26 03:15:14.237773 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 517/1062] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:15:14 2022] GET /compute/v2.1/servers/d87611df-64cb-42cb-b734-782bf9ebb9ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:16:33.413503 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:16:33.414152 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Sun Jun 26 03:16:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:16:35.252974 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:16:35.253709 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=39 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:16:35.258589 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c02e2833-f46f-4423-99ea-1d62673aba1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:16:35.259543 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c02e2833-f46f-4423-99ea-1d62673aba1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:35.267232 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c02e2833-f46f-4423-99ea-1d62673aba1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:35.267684 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c02e2833-f46f-4423-99ea-1d62673aba1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:35.268448 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c02e2833-f46f-4423-99ea-1d62673aba1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:35.268889 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c02e2833-f46f-4423-99ea-1d62673aba1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:35.339562 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c02e2833-f46f-4423-99ea-1d62673aba1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "POST /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/action" status: 202 len: 0 microversion: 2.1 time: 0.088163 Jun 26 03:16:35.340171 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 546/1063] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:16:35 2022] POST /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:16:35.346855 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:16:35.347597 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:16:35.352000 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-9d89628e-e72d-48bb-8588-d25d9bc32df3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:35.352637 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-9d89628e-e72d-48bb-8588-d25d9bc32df3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:35.361784 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9d89628e-e72d-48bb-8588-d25d9bc32df3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:35.362340 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9d89628e-e72d-48bb-8588-d25d9bc32df3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:35.363107 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9d89628e-e72d-48bb-8588-d25d9bc32df3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:35.363541 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-9d89628e-e72d-48bb-8588-d25d9bc32df3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:35.516658 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-9d89628e-e72d-48bb-8588-d25d9bc32df3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:35.524580 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-9d89628e-e72d-48bb-8588-d25d9bc32df3 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1752 microversion: 2.1 time: 0.179659 Jun 26 03:16:35.525122 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 518/1064] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:35 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:36.543295 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-855ab2c5-1cba-4c61-9791-61d715f39ab1 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:36.544003 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-855ab2c5-1cba-4c61-9791-61d715f39ab1 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:36.550303 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-855ab2c5-1cba-4c61-9791-61d715f39ab1 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:36.550710 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-855ab2c5-1cba-4c61-9791-61d715f39ab1 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:36.551477 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-855ab2c5-1cba-4c61-9791-61d715f39ab1 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:36.551912 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-855ab2c5-1cba-4c61-9791-61d715f39ab1 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:36.695086 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-855ab2c5-1cba-4c61-9791-61d715f39ab1 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:36.703680 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-855ab2c5-1cba-4c61-9791-61d715f39ab1 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.164610 Jun 26 03:16:36.704256 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 547/1065] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:36 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:37.721978 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-0bd383ae-a7c4-4beb-99c4-89c3a2b6b752 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:37.722562 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-0bd383ae-a7c4-4beb-99c4-89c3a2b6b752 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:37.729224 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0bd383ae-a7c4-4beb-99c4-89c3a2b6b752 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:37.729678 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0bd383ae-a7c4-4beb-99c4-89c3a2b6b752 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:37.730559 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0bd383ae-a7c4-4beb-99c4-89c3a2b6b752 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:37.730996 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-0bd383ae-a7c4-4beb-99c4-89c3a2b6b752 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:37.871461 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-0bd383ae-a7c4-4beb-99c4-89c3a2b6b752 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:37.880197 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-0bd383ae-a7c4-4beb-99c4-89c3a2b6b752 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.163161 Jun 26 03:16:37.880767 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 519/1066] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:37 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:38.899639 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ad80346f-b8c1-4e4d-a7aa-6acfe310f931 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:38.900385 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ad80346f-b8c1-4e4d-a7aa-6acfe310f931 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:38.906994 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ad80346f-b8c1-4e4d-a7aa-6acfe310f931 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:38.907483 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ad80346f-b8c1-4e4d-a7aa-6acfe310f931 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:38.908301 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ad80346f-b8c1-4e4d-a7aa-6acfe310f931 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:38.908794 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ad80346f-b8c1-4e4d-a7aa-6acfe310f931 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:39.095254 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ad80346f-b8c1-4e4d-a7aa-6acfe310f931 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:39.104058 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ad80346f-b8c1-4e4d-a7aa-6acfe310f931 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.209188 Jun 26 03:16:39.104763 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 548/1067] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:38 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:40.121893 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-af50f427-8ac0-4e0e-a009-8cecb8d334ad tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:40.122535 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-af50f427-8ac0-4e0e-a009-8cecb8d334ad tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:40.129311 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-af50f427-8ac0-4e0e-a009-8cecb8d334ad tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:40.129761 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-af50f427-8ac0-4e0e-a009-8cecb8d334ad tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:40.131485 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-af50f427-8ac0-4e0e-a009-8cecb8d334ad tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:40.131978 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-af50f427-8ac0-4e0e-a009-8cecb8d334ad tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:40.287273 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-af50f427-8ac0-4e0e-a009-8cecb8d334ad tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:40.295573 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-af50f427-8ac0-4e0e-a009-8cecb8d334ad tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.177554 Jun 26 03:16:40.296446 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 520/1068] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:40 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:41.312516 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-73ab1f66-4882-44dd-92b5-9fb63b07cebc tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:41.313138 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-73ab1f66-4882-44dd-92b5-9fb63b07cebc tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:41.319559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-73ab1f66-4882-44dd-92b5-9fb63b07cebc tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:41.320016 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-73ab1f66-4882-44dd-92b5-9fb63b07cebc tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:41.320785 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-73ab1f66-4882-44dd-92b5-9fb63b07cebc tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:41.321228 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-73ab1f66-4882-44dd-92b5-9fb63b07cebc tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:41.487792 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-73ab1f66-4882-44dd-92b5-9fb63b07cebc tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:41.496052 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-73ab1f66-4882-44dd-92b5-9fb63b07cebc tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.187414 Jun 26 03:16:41.496622 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 549/1069] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:41 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:42.512415 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-795e1532-52eb-4ca2-b94d-1263f0e5a149 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:42.513023 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-795e1532-52eb-4ca2-b94d-1263f0e5a149 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:42.519449 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-795e1532-52eb-4ca2-b94d-1263f0e5a149 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:42.519896 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-795e1532-52eb-4ca2-b94d-1263f0e5a149 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:42.520652 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-795e1532-52eb-4ca2-b94d-1263f0e5a149 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:42.521087 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-795e1532-52eb-4ca2-b94d-1263f0e5a149 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:42.661069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-795e1532-52eb-4ca2-b94d-1263f0e5a149 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:42.669048 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-795e1532-52eb-4ca2-b94d-1263f0e5a149 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.160418 Jun 26 03:16:42.670365 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 521/1070] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:42 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:43.687664 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d74fff4e-823b-468b-a846-c91815601755 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:43.687664 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d74fff4e-823b-468b-a846-c91815601755 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:43.693025 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d74fff4e-823b-468b-a846-c91815601755 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:43.693477 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d74fff4e-823b-468b-a846-c91815601755 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:43.694276 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d74fff4e-823b-468b-a846-c91815601755 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:43.694717 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d74fff4e-823b-468b-a846-c91815601755 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:43.838875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d74fff4e-823b-468b-a846-c91815601755 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:43.846648 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d74fff4e-823b-468b-a846-c91815601755 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.164210 Jun 26 03:16:43.847214 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 550/1071] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:43 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:44.863904 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f2ed903e-2d5f-4f40-8fbb-b852764fb3cb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:44.865097 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f2ed903e-2d5f-4f40-8fbb-b852764fb3cb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:44.871654 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f2ed903e-2d5f-4f40-8fbb-b852764fb3cb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:44.872108 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f2ed903e-2d5f-4f40-8fbb-b852764fb3cb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:44.872996 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f2ed903e-2d5f-4f40-8fbb-b852764fb3cb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:44.873427 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f2ed903e-2d5f-4f40-8fbb-b852764fb3cb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:45.031531 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f2ed903e-2d5f-4f40-8fbb-b852764fb3cb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:45.040435 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f2ed903e-2d5f-4f40-8fbb-b852764fb3cb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.180554 Jun 26 03:16:45.041008 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 522/1072] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:44 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:46.057640 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-5006761f-0e47-4867-9e06-363fdaf5a265 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:46.058209 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-5006761f-0e47-4867-9e06-363fdaf5a265 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:46.064978 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5006761f-0e47-4867-9e06-363fdaf5a265 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:46.065433 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5006761f-0e47-4867-9e06-363fdaf5a265 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:46.066236 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5006761f-0e47-4867-9e06-363fdaf5a265 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:46.066677 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-5006761f-0e47-4867-9e06-363fdaf5a265 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:46.208072 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-5006761f-0e47-4867-9e06-363fdaf5a265 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:46.216091 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-5006761f-0e47-4867-9e06-363fdaf5a265 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.162111 Jun 26 03:16:46.216653 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 551/1073] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:46 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:47.233198 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1b04230c-2fcc-4163-89ff-0b2082531c3b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:47.233804 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1b04230c-2fcc-4163-89ff-0b2082531c3b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:47.240296 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1b04230c-2fcc-4163-89ff-0b2082531c3b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:47.240745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1b04230c-2fcc-4163-89ff-0b2082531c3b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:47.241507 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1b04230c-2fcc-4163-89ff-0b2082531c3b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:47.241944 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1b04230c-2fcc-4163-89ff-0b2082531c3b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:47.381371 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1b04230c-2fcc-4163-89ff-0b2082531c3b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:47.389252 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1b04230c-2fcc-4163-89ff-0b2082531c3b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.160146 Jun 26 03:16:47.389816 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 523/1074] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:47 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:48.406436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-907e84c1-6210-42b5-ad9c-1c0d992cd8c8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:48.407072 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-907e84c1-6210-42b5-ad9c-1c0d992cd8c8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:48.413446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-907e84c1-6210-42b5-ad9c-1c0d992cd8c8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:48.413907 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-907e84c1-6210-42b5-ad9c-1c0d992cd8c8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:48.414705 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-907e84c1-6210-42b5-ad9c-1c0d992cd8c8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:48.415146 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-907e84c1-6210-42b5-ad9c-1c0d992cd8c8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:48.555798 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-907e84c1-6210-42b5-ad9c-1c0d992cd8c8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:48.564157 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-907e84c1-6210-42b5-ad9c-1c0d992cd8c8 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.161570 Jun 26 03:16:48.564725 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 552/1075] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:48 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:49.581175 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ca7478b4-47db-4717-a338-b3a0289a9604 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:49.581751 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ca7478b4-47db-4717-a338-b3a0289a9604 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:49.588456 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ca7478b4-47db-4717-a338-b3a0289a9604 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:49.588911 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ca7478b4-47db-4717-a338-b3a0289a9604 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:49.589676 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ca7478b4-47db-4717-a338-b3a0289a9604 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:49.590156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ca7478b4-47db-4717-a338-b3a0289a9604 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:49.730832 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ca7478b4-47db-4717-a338-b3a0289a9604 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:49.738800 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ca7478b4-47db-4717-a338-b3a0289a9604 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.162039 Jun 26 03:16:49.739510 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 524/1076] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:49 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:50.755788 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3087aaee-60d2-40a9-90f4-aa6094212319 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:50.756401 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3087aaee-60d2-40a9-90f4-aa6094212319 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:50.762909 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3087aaee-60d2-40a9-90f4-aa6094212319 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:50.763363 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3087aaee-60d2-40a9-90f4-aa6094212319 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:50.764128 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3087aaee-60d2-40a9-90f4-aa6094212319 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:50.764566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3087aaee-60d2-40a9-90f4-aa6094212319 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:50.908904 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3087aaee-60d2-40a9-90f4-aa6094212319 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:50.916807 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3087aaee-60d2-40a9-90f4-aa6094212319 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.165099 Jun 26 03:16:50.917372 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 553/1077] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:50 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:51.934332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4dcc4d2b-4ff6-43d6-a954-a1eaddf2e7c2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:51.934887 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4dcc4d2b-4ff6-43d6-a954-a1eaddf2e7c2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:51.941419 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4dcc4d2b-4ff6-43d6-a954-a1eaddf2e7c2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:51.941876 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4dcc4d2b-4ff6-43d6-a954-a1eaddf2e7c2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:51.942682 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4dcc4d2b-4ff6-43d6-a954-a1eaddf2e7c2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:51.943127 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4dcc4d2b-4ff6-43d6-a954-a1eaddf2e7c2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:52.081109 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4dcc4d2b-4ff6-43d6-a954-a1eaddf2e7c2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:52.089013 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4dcc4d2b-4ff6-43d6-a954-a1eaddf2e7c2 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.158743 Jun 26 03:16:52.089579 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 525/1078] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:51 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:53.105795 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b353bef7-89f4-43fe-b0b8-c73115617ecb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:53.106443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b353bef7-89f4-43fe-b0b8-c73115617ecb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:53.112749 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b353bef7-89f4-43fe-b0b8-c73115617ecb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:53.113201 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b353bef7-89f4-43fe-b0b8-c73115617ecb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:53.113961 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b353bef7-89f4-43fe-b0b8-c73115617ecb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:53.114433 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b353bef7-89f4-43fe-b0b8-c73115617ecb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:53.260667 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b353bef7-89f4-43fe-b0b8-c73115617ecb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:53.268800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b353bef7-89f4-43fe-b0b8-c73115617ecb tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1757 microversion: 2.1 time: 0.166849 Jun 26 03:16:53.269371 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 554/1079] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:53 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:16:54.285899 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ae73b827-e5b1-48f3-8718-fb8c56975e39 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:16:54.286571 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ae73b827-e5b1-48f3-8718-fb8c56975e39 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:16:54.293170 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ae73b827-e5b1-48f3-8718-fb8c56975e39 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:54.293629 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ae73b827-e5b1-48f3-8718-fb8c56975e39 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:54.294436 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ae73b827-e5b1-48f3-8718-fb8c56975e39 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:16:54.294884 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ae73b827-e5b1-48f3-8718-fb8c56975e39 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:16:54.463702 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ae73b827-e5b1-48f3-8718-fb8c56975e39 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:16:54.475753 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ae73b827-e5b1-48f3-8718-fb8c56975e39 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1760 microversion: 2.1 time: 0.194163 Jun 26 03:16:54.476988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 526/1080] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:16:54 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1760 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:17:41.380422 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=18 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:17:41.381872 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:17:41.559142 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e0f81cf7-de35-488f-96a2-8608f26f2ab4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Action: 'create', calling method: .version_select at 0x7f58276b88b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2005754739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrpffdJHolcHgpt/TsYWtFqUm2+1qLI6ChgnBAATccqS6TbxfIoUkuxYqdooLIdUUMmS4iebdgF3FYw/JofmsEHwqgWvzxB4lh/vD1rLFFw3V9jJ1hh8bVGVR7lfe2Mww=="}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:17:41.573544 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-e0f81cf7-de35-488f-96a2-8608f26f2ab4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Getting quotas for project 80a33a31ba6046e78352f5ba9e88b9fe. Resources: {'key_pairs'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:17:41.577839 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-e0f81cf7-de35-488f-96a2-8608f26f2ab4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Getting quotas for user faa6dfc6e5c14046b499354e0f07a404 and project 80a33a31ba6046e78352f5ba9e88b9fe. Resources: {'key_pairs'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:17:41.590106 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e0f81cf7-de35-488f-96a2-8608f26f2ab4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [c0400173-c90d-4b9f-8ea1-831f8df2c05d] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 26 03:17:42.598777 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO oslo.messaging._drivers.impl_rabbit [None req-e0f81cf7-de35-488f-96a2-8608f26f2ab4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [c0400173-c90d-4b9f-8ea1-831f8df2c05d] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60124. Jun 26 03:17:42.613354 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e0f81cf7-de35-488f-96a2-8608f26f2ab4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.238469 Jun 26 03:17:42.614168 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 555/1081] 10.222.0.13 () {60 vars in 1158 bytes} [Sun Jun 26 03:17:41 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:18:02.722838 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:18:02.723523 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Sun Jun 26 03:18:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:18:05.099576 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=18 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:18:05.100408 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=54 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:18:05.104735 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-203970875", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2005754739", "security_groups": [{"name": "tempest-secgroup-smoke-845059020"}], "networks": [{"uuid": "82c4a88c-3604-4e5f-902b-8a29b8be9dd0"}], "block_device_mapping_v2": [{"uuid": "76762ac0-0cca-4861-a883-28036d2393ca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:18:05.213362 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.network.neutron [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] validate_networks() for [('82c4a88c-3604-4e5f-902b-8a29b8be9dd0', None, None, None, None, None)] {{(pid=117782) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:18:05.664553 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Flavor limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:18:05.664981 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Image limits 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:18:05.665462 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Flavor pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:18:05.665877 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Image pref 0:0:0 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:18:05.666333 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.virt.hardware [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:18:05.676868 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:05.677323 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:05.678159 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:05.678609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:05.695011 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Getting quotas for project 80a33a31ba6046e78352f5ba9e88b9fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:18:05.698957 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Getting quotas for user faa6dfc6e5c14046b499354e0f07a404 and project 80a33a31ba6046e78352f5ba9e88b9fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:18:05.754794 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Going to run 1 instances... {{(pid=117782) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:18:05.757108 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76762ac0-0cca-4861-a883-28036d2393ca',volume_size=None,volume_type=None)] {{(pid=117782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:18:05.894652 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-417913dd-82cf-402a-aa5b-04d353341acb tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.796092 Jun 26 03:18:05.895291 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 527/1082] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:18:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:18:05.905413 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2356b146-aeae-4276-8080-3f8cc100d246 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:05.906089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2356b146-aeae-4276-8080-3f8cc100d246 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:05.908239 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=4 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:18:05.908894 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:18:05.966296 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-2356b146-aeae-4276-8080-3f8cc100d246 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:05.974018 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2356b146-aeae-4276-8080-3f8cc100d246 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1088 microversion: 2.1 time: 0.072626 Jun 26 03:18:05.974624 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 556/1083] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:05 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:06.991447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fb7f3465-1371-4172-a6fb-87269bd1ec08 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:06.991988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-fb7f3465-1371-4172-a6fb-87269bd1ec08 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:06.998088 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fb7f3465-1371-4172-a6fb-87269bd1ec08 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:06.998540 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fb7f3465-1371-4172-a6fb-87269bd1ec08 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:06.999292 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fb7f3465-1371-4172-a6fb-87269bd1ec08 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:06.999727 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fb7f3465-1371-4172-a6fb-87269bd1ec08 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:07.063410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-fb7f3465-1371-4172-a6fb-87269bd1ec08 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:07.071345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-fb7f3465-1371-4172-a6fb-87269bd1ec08 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1186 microversion: 2.1 time: 0.084402 Jun 26 03:18:07.071902 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 528/1084] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:06 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:08.089064 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-4d8f0a6f-a3e4-44dd-8638-3136e0bc6358 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:08.089622 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-4d8f0a6f-a3e4-44dd-8638-3136e0bc6358 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:08.096155 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d8f0a6f-a3e4-44dd-8638-3136e0bc6358 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:08.096745 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d8f0a6f-a3e4-44dd-8638-3136e0bc6358 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:08.098567 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d8f0a6f-a3e4-44dd-8638-3136e0bc6358 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:08.099241 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-4d8f0a6f-a3e4-44dd-8638-3136e0bc6358 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:08.335200 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-4d8f0a6f-a3e4-44dd-8638-3136e0bc6358 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:08.342533 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-4d8f0a6f-a3e4-44dd-8638-3136e0bc6358 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1259 microversion: 2.1 time: 0.257371 Jun 26 03:18:08.343101 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 557/1085] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:08 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1259 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:08.715721 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-6445bce1-3e1a-4844-b3eb-6c7e33279db4 req-e981c90b-bb1e-49f6-b44d-fe5c71a565a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad8a4d7-e228-4988-a099-a49eba183537", "tag": "8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:18:08.725447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-6445bce1-3e1a-4844-b3eb-6c7e33279db4 req-e981c90b-bb1e-49f6-b44d-fe5c71a565a0 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:08.726008 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-6445bce1-3e1a-4844-b3eb-6c7e33279db4 req-e981c90b-bb1e-49f6-b44d-fe5c71a565a0 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:08.740035 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-6445bce1-3e1a-4844-b3eb-6c7e33279db4 req-e981c90b-bb1e-49f6-b44d-fe5c71a565a0 service nova] Creating event network-changed:8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf for instance dad8a4d7-e228-4988-a099-a49eba183537 on hv-cinder-84684 Jun 26 03:18:08.745377 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-6445bce1-3e1a-4844-b3eb-6c7e33279db4 req-e981c90b-bb1e-49f6-b44d-fe5c71a565a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119311 Jun 26 03:18:08.745972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 529/1086] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:18:09.359510 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e42fc411-768c-4293-94eb-3ab458e15a4f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:09.360060 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e42fc411-768c-4293-94eb-3ab458e15a4f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:09.367235 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e42fc411-768c-4293-94eb-3ab458e15a4f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:09.367697 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e42fc411-768c-4293-94eb-3ab458e15a4f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:09.368469 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e42fc411-768c-4293-94eb-3ab458e15a4f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:09.368915 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e42fc411-768c-4293-94eb-3ab458e15a4f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:09.507931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e42fc411-768c-4293-94eb-3ab458e15a4f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:09.515412 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e42fc411-768c-4293-94eb-3ab458e15a4f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1259 microversion: 2.1 time: 0.159867 Jun 26 03:18:09.515973 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 558/1087] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:09 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:10.532543 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7e76a4fc-a547-46b4-a2e3-b6ab2182fe6a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:10.533242 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7e76a4fc-a547-46b4-a2e3-b6ab2182fe6a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:10.539829 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7e76a4fc-a547-46b4-a2e3-b6ab2182fe6a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:10.540287 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7e76a4fc-a547-46b4-a2e3-b6ab2182fe6a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:10.541048 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7e76a4fc-a547-46b4-a2e3-b6ab2182fe6a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:10.541489 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7e76a4fc-a547-46b4-a2e3-b6ab2182fe6a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:10.671435 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-7e76a4fc-a547-46b4-a2e3-b6ab2182fe6a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:10.679329 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-7e76a4fc-a547-46b4-a2e3-b6ab2182fe6a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1259 microversion: 2.1 time: 0.150999 Jun 26 03:18:10.679893 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 530/1088] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:10 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:11.696850 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d424117d-152b-4f2d-8397-235eab3676fc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:11.697378 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d424117d-152b-4f2d-8397-235eab3676fc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:11.703782 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d424117d-152b-4f2d-8397-235eab3676fc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:11.704229 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d424117d-152b-4f2d-8397-235eab3676fc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:11.704980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d424117d-152b-4f2d-8397-235eab3676fc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:11.705414 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d424117d-152b-4f2d-8397-235eab3676fc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:11.843428 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d424117d-152b-4f2d-8397-235eab3676fc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:11.853941 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d424117d-152b-4f2d-8397-235eab3676fc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1259 microversion: 2.1 time: 0.159829 Jun 26 03:18:11.853941 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 559/1089] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:11 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:12.870177 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3d1e81ed-46fa-4f65-9992-a617998334c4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:12.870795 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3d1e81ed-46fa-4f65-9992-a617998334c4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:12.877333 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3d1e81ed-46fa-4f65-9992-a617998334c4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:12.877786 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3d1e81ed-46fa-4f65-9992-a617998334c4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:12.878584 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3d1e81ed-46fa-4f65-9992-a617998334c4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:12.879026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3d1e81ed-46fa-4f65-9992-a617998334c4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:13.009549 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-3d1e81ed-46fa-4f65-9992-a617998334c4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:13.016843 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3d1e81ed-46fa-4f65-9992-a617998334c4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1259 microversion: 2.1 time: 0.150585 Jun 26 03:18:13.017409 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 531/1090] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:12 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:14.033667 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3b7edd84-fd88-4045-a9a5-3de331968616 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:14.034238 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3b7edd84-fd88-4045-a9a5-3de331968616 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:14.040689 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b7edd84-fd88-4045-a9a5-3de331968616 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:14.041149 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b7edd84-fd88-4045-a9a5-3de331968616 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:14.041920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b7edd84-fd88-4045-a9a5-3de331968616 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:14.042395 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3b7edd84-fd88-4045-a9a5-3de331968616 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:14.165450 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f499bf50-edf0-4bf2-965d-894268582e72 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1274287002"}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:18:14.166019 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f499bf50-edf0-4bf2-965d-894268582e72 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:14.172497 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f499bf50-edf0-4bf2-965d-894268582e72 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:14.172946 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f499bf50-edf0-4bf2-965d-894268582e72 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:14.173705 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f499bf50-edf0-4bf2-965d-894268582e72 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:14.174162 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f499bf50-edf0-4bf2-965d-894268582e72 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:14.174672 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3b7edd84-fd88-4045-a9a5-3de331968616 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:14.182703 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3b7edd84-fd88-4045-a9a5-3de331968616 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1259 microversion: 2.1 time: 0.153014 Jun 26 03:18:14.183277 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 560/1091] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:14 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:14.302671 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.network.security_group_api [None req-f499bf50-edf0-4bf2-965d-894268582e72 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Removing security group 04e92ec5-b39d-4c95-a918-6367021dd02f from port f6eda47f-5905-49d5-b36d-bb51bf670b9f Jun 26 03:18:14.627347 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f499bf50-edf0-4bf2-965d-894268582e72 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "POST /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/action" status: 202 len: 0 microversion: 2.1 time: 0.465756 Jun 26 03:18:14.627935 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 532/1092] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:18:14 2022] POST /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 26 03:18:14.641008 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-fadd973e-d6d2-4622-9fb1-c188c437e2c4 req-5f53f7ef-5dc3-492b-bc98-dc4ff928708a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fc861c4-11c3-4fb8-8744-9b792b9864f7", "tag": "f6eda47f-5905-49d5-b36d-bb51bf670b9f"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:18:14.654846 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-fadd973e-d6d2-4622-9fb1-c188c437e2c4 req-5f53f7ef-5dc3-492b-bc98-dc4ff928708a service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:14.655452 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-fadd973e-d6d2-4622-9fb1-c188c437e2c4 req-5f53f7ef-5dc3-492b-bc98-dc4ff928708a service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:14.668208 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-fadd973e-d6d2-4622-9fb1-c188c437e2c4 req-5f53f7ef-5dc3-492b-bc98-dc4ff928708a service nova] Creating event network-changed:f6eda47f-5905-49d5-b36d-bb51bf670b9f for instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 on hv-cinder-84684 Jun 26 03:18:14.674017 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-fadd973e-d6d2-4622-9fb1-c188c437e2c4 req-5f53f7ef-5dc3-492b-bc98-dc4ff928708a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039038 Jun 26 03:18:14.675929 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 561/1093] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:18:15.200350 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-2c2efbf9-22c4-4fce-8f7c-5de08bc1bc35 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:15.201118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-2c2efbf9-22c4-4fce-8f7c-5de08bc1bc35 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:15.208025 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2c2efbf9-22c4-4fce-8f7c-5de08bc1bc35 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:15.208506 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2c2efbf9-22c4-4fce-8f7c-5de08bc1bc35 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:15.209410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2c2efbf9-22c4-4fce-8f7c-5de08bc1bc35 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:15.210069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-2c2efbf9-22c4-4fce-8f7c-5de08bc1bc35 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:15.344007 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-2c2efbf9-22c4-4fce-8f7c-5de08bc1bc35 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:15.351728 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-2c2efbf9-22c4-4fce-8f7c-5de08bc1bc35 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1259 microversion: 2.1 time: 0.155210 Jun 26 03:18:15.352312 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 533/1094] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:15 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:15.683802 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1006afda-3be6-4651-bbb7-3d3f33af0e1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:15.684388 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1006afda-3be6-4651-bbb7-3d3f33af0e1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:15.686281 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=2 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:18:15.692977 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1006afda-3be6-4651-bbb7-3d3f33af0e1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:15.693631 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1006afda-3be6-4651-bbb7-3d3f33af0e1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:15.694618 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1006afda-3be6-4651-bbb7-3d3f33af0e1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:15.696006 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1006afda-3be6-4651-bbb7-3d3f33af0e1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:15.706164 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=6 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:18:15.742764 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-a0a48e86-d3d0-45b6-a534-af274e3059ce req-53a5abe5-2eb1-466e-b2d4-f28de1ba6970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fc861c4-11c3-4fb8-8744-9b792b9864f7", "tag": "f6eda47f-5905-49d5-b36d-bb51bf670b9f"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:18:15.752469 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-a0a48e86-d3d0-45b6-a534-af274e3059ce req-53a5abe5-2eb1-466e-b2d4-f28de1ba6970 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:15.752925 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-a0a48e86-d3d0-45b6-a534-af274e3059ce req-53a5abe5-2eb1-466e-b2d4-f28de1ba6970 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:15.764983 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-a0a48e86-d3d0-45b6-a534-af274e3059ce req-53a5abe5-2eb1-466e-b2d4-f28de1ba6970 service nova] Creating event network-changed:f6eda47f-5905-49d5-b36d-bb51bf670b9f for instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 on hv-cinder-84684 Jun 26 03:18:15.770439 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-a0a48e86-d3d0-45b6-a534-af274e3059ce req-53a5abe5-2eb1-466e-b2d4-f28de1ba6970 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089247 Jun 26 03:18:15.771026 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 534/1095] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:18:15.787164 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.objects.instance [None req-1006afda-3be6-4651-bbb7-3d3f33af0e1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lazy-loading 'services' on Instance uuid 1fc861c4-11c3-4fb8-8744-9b792b9864f7 {{(pid=117783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:18:15.860621 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1006afda-3be6-4651-bbb7-3d3f33af0e1e tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/os-volume_attachments/b45e8ece-707c-484a-a274-a379b3d2859b" status: 202 len: 0 microversion: 2.1 time: 0.181225 Jun 26 03:18:15.861210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 562/1096] 10.222.0.13 () {58 vars in 1415 bytes} [Sun Jun 26 03:18:15 2022] DELETE /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/os-volume_attachments/b45e8ece-707c-484a-a274-a379b3d2859b => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:18:15.874275 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-22fe5ba5-cfd3-407c-b396-f5d3dbf46184 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:15.875372 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-22fe5ba5-cfd3-407c-b396-f5d3dbf46184 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:15.882582 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-22fe5ba5-cfd3-407c-b396-f5d3dbf46184 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:15.882971 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-22fe5ba5-cfd3-407c-b396-f5d3dbf46184 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:15.883767 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-22fe5ba5-cfd3-407c-b396-f5d3dbf46184 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:15.884206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-22fe5ba5-cfd3-407c-b396-f5d3dbf46184 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:15.914138 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-22fe5ba5-cfd3-407c-b396-f5d3dbf46184 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044238 Jun 26 03:18:15.914719 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 535/1097] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:18:15 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:18:16.367053 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=2 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:18:16.372387 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-c3bd6a73-51af-4f23-956a-74b144fe6cce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:16.373466 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-c3bd6a73-51af-4f23-956a-74b144fe6cce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:16.381010 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c3bd6a73-51af-4f23-956a-74b144fe6cce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:16.382021 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c3bd6a73-51af-4f23-956a-74b144fe6cce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:16.382849 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c3bd6a73-51af-4f23-956a-74b144fe6cce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:16.383298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-c3bd6a73-51af-4f23-956a-74b144fe6cce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:16.604173 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-c3bd6a73-51af-4f23-956a-74b144fe6cce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:16.611946 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-c3bd6a73-51af-4f23-956a-74b144fe6cce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1259 microversion: 2.1 time: 0.246622 Jun 26 03:18:16.612514 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 563/1098] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:16 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:16.925517 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-53f1ff4f-d38d-4d70-82a7-9ac76a871abe tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:16.926472 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-53f1ff4f-d38d-4d70-82a7-9ac76a871abe tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:16.932795 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-53f1ff4f-d38d-4d70-82a7-9ac76a871abe tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:16.933246 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-53f1ff4f-d38d-4d70-82a7-9ac76a871abe tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:16.934017 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-53f1ff4f-d38d-4d70-82a7-9ac76a871abe tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:16.934484 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-53f1ff4f-d38d-4d70-82a7-9ac76a871abe tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:16.963974 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-53f1ff4f-d38d-4d70-82a7-9ac76a871abe tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042357 Jun 26 03:18:16.964659 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 536/1099] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:18:16 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:18:17.628655 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-55b8c334-d230-474b-b988-412712f97d52 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:17.629266 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-55b8c334-d230-474b-b988-412712f97d52 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:17.636276 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-55b8c334-d230-474b-b988-412712f97d52 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:17.636730 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-55b8c334-d230-474b-b988-412712f97d52 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:17.637489 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-55b8c334-d230-474b-b988-412712f97d52 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:17.637928 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-55b8c334-d230-474b-b988-412712f97d52 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:17.775567 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-55b8c334-d230-474b-b988-412712f97d52 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:17.782964 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-55b8c334-d230-474b-b988-412712f97d52 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1259 microversion: 2.1 time: 0.158181 Jun 26 03:18:17.783521 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 564/1100] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:17 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:17.975585 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8a3407a0-d5c4-494f-b15e-2fcac2ca1224 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:17.976434 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8a3407a0-d5c4-494f-b15e-2fcac2ca1224 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:17.982849 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8a3407a0-d5c4-494f-b15e-2fcac2ca1224 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:17.983299 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8a3407a0-d5c4-494f-b15e-2fcac2ca1224 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:17.984049 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8a3407a0-d5c4-494f-b15e-2fcac2ca1224 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:17.984481 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8a3407a0-d5c4-494f-b15e-2fcac2ca1224 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:18.013396 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8a3407a0-d5c4-494f-b15e-2fcac2ca1224 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042397 Jun 26 03:18:18.013960 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 537/1101] 10.222.0.13 () {58 vars in 1301 bytes} [Sun Jun 26 03:18:17 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 26 03:18:18.024283 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-76f4357b-0bf6-40d4-9209-31224a9aca9b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:18.024772 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-76f4357b-0bf6-40d4-9209-31224a9aca9b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:18.031124 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-76f4357b-0bf6-40d4-9209-31224a9aca9b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:18.031573 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-76f4357b-0bf6-40d4-9209-31224a9aca9b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:18.032331 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-76f4357b-0bf6-40d4-9209-31224a9aca9b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:18.032763 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-76f4357b-0bf6-40d4-9209-31224a9aca9b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:18.111857 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-76f4357b-0bf6-40d4-9209-31224a9aca9b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] HTTP exception thrown: Instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 is not attached to volume b45e8ece-707c-484a-a274-a379b3d2859b Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-76f4357b-0bf6-40d4-9209-31224a9aca9b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Request method failure captured: Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: DELETE /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/os-volume_attachments/b45e8ece-707c-484a-a274-a379b3d2859b HTTP/1.1 Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8748KeiQxLo6akDPqFsM0K66us2SdirHO1BCfAJ1HgBAX-N6NeCI8jTWK3Mk2USWscn8tXVNw2kiT_8VqmgESCvu4MsLMNNWH7HEJqSvuzyyh4W0JRpi33GwD11eo7btWC1obzXURN2MR8hdcuI0LXxLL0OoelpZmQRUjaXSUQRPTo Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 1fe0cd601688420d88ea051894cfdf2a Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-TestMinimumBasicScenario-268170511 Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:18:18.114321 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:18:18.115832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fe0cd601688420d88ea051894cfdf2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fe0cd601688420d88ea051894cfdf2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fe0cd601688420d88ea051894cfdf2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fe0cd601688420d88ea051894cfdf2a"}]}] Jun 26 03:18:18.115832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-TestMinimumBasicScenario-268170511 Jun 26 03:18:18.115832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 1fe0cd601688420d88ea051894cfdf2a Jun 26 03:18:18.115832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-TestMinimumBasicScenario-268170511 Jun 26 03:18:18.115832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-TestMinimumBasicScenario-268170511-project Jun 26 03:18:18.115832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:18:18.115832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:18:18.115832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 1042fb5384e14cd2bc7090f09db977c2 Jun 26 03:18:18.115832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-TestMinimumBasicScenario-268170511-project Jun 26 03:18:18.115832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:18:18.115832 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 is not attached to volume b45e8ece-707c-484a-a274-a379b3d2859b Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'server_id': '1fc861c4-11c3-4fb8-8744-9b792b9864f7', 'id': 'b45e8ece-707c-484a-a274-a379b3d2859b'} Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b45e8ece-707c-484a-a274-a379b3d2859b. Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:18:18.116571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 is not attached to volume b45e8ece-707c-484a-a274-a379b3d2859b Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 is not attached to volume b45e8ece-707c-484a-a274-a379b3d2859b Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:18:18.118134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-76f4357b-0bf6-40d4-9209-31224a9aca9b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Returning 404 to user: Instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 is not attached to volume b45e8ece-707c-484a-a274-a379b3d2859b {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:18:18.119309 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-76f4357b-0bf6-40d4-9209-31224a9aca9b tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/os-volume_attachments/b45e8ece-707c-484a-a274-a379b3d2859b" status: 404 len: 154 microversion: 2.1 time: 0.095509 Jun 26 03:18:18.119309 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 565/1102] 10.222.0.13 () {58 vars in 1415 bytes} [Sun Jun 26 03:18:18 2022] DELETE /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7/os-volume_attachments/b45e8ece-707c-484a-a274-a379b3d2859b => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:18:18.799805 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4e316199-f340-42fc-b2c0-398ba9f80612 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:18.800932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4e316199-f340-42fc-b2c0-398ba9f80612 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:18.806876 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4e316199-f340-42fc-b2c0-398ba9f80612 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:18.807327 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4e316199-f340-42fc-b2c0-398ba9f80612 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:18.808092 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4e316199-f340-42fc-b2c0-398ba9f80612 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:18.808534 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4e316199-f340-42fc-b2c0-398ba9f80612 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:18.938818 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4e316199-f340-42fc-b2c0-398ba9f80612 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:18.947555 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4e316199-f340-42fc-b2c0-398ba9f80612 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1259 microversion: 2.1 time: 0.151709 Jun 26 03:18:18.948117 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 538/1103] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:18 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:18:19.247475 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-17780d8f-cc45-4f64-be30-ecb190c00148 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:19.247969 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-17780d8f-cc45-4f64-be30-ecb190c00148 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:19.255305 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17780d8f-cc45-4f64-be30-ecb190c00148 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:19.255820 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17780d8f-cc45-4f64-be30-ecb190c00148 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:19.256843 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17780d8f-cc45-4f64-be30-ecb190c00148 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:19.257284 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-17780d8f-cc45-4f64-be30-ecb190c00148 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:19.281886 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-17780d8f-cc45-4f64-be30-ecb190c00148 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Going to try to terminate instance {{(pid=117783) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:18:19.357120 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-17780d8f-cc45-4f64-be30-ecb190c00148 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 204 len: 0 microversion: 2.1 time: 0.113554 Jun 26 03:18:19.358218 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 566/1104] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:18:19 2022] DELETE /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:18:19.365908 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c7d7d5d1-e57e-4f88-9bf9-38311ae7f9a0 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:19.367213 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c7d7d5d1-e57e-4f88-9bf9-38311ae7f9a0 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:19.373696 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c7d7d5d1-e57e-4f88-9bf9-38311ae7f9a0 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:19.374415 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c7d7d5d1-e57e-4f88-9bf9-38311ae7f9a0 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:19.375198 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c7d7d5d1-e57e-4f88-9bf9-38311ae7f9a0 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:19.375636 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c7d7d5d1-e57e-4f88-9bf9-38311ae7f9a0 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:19.505495 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c7d7d5d1-e57e-4f88-9bf9-38311ae7f9a0 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:19.513120 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c7d7d5d1-e57e-4f88-9bf9-38311ae7f9a0 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1555 microversion: 2.1 time: 0.151148 Jun 26 03:18:19.513675 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 539/1105] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:19 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:18:19.964753 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-7064fc6d-45c8-4913-8f5b-a2b78e25ea49 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:19.965468 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-7064fc6d-45c8-4913-8f5b-a2b78e25ea49 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:19.971429 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7064fc6d-45c8-4913-8f5b-a2b78e25ea49 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:19.971876 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7064fc6d-45c8-4913-8f5b-a2b78e25ea49 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:19.972660 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7064fc6d-45c8-4913-8f5b-a2b78e25ea49 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:19.973376 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7064fc6d-45c8-4913-8f5b-a2b78e25ea49 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:20.100350 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-7064fc6d-45c8-4913-8f5b-a2b78e25ea49 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:20.107660 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-7064fc6d-45c8-4913-8f5b-a2b78e25ea49 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1259 microversion: 2.1 time: 0.147016 Jun 26 03:18:20.108159 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 567/1106] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:19 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:20.531511 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5c5f1bfe-feb4-4308-867a-5ec2a746b505 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:20.532126 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5c5f1bfe-feb4-4308-867a-5ec2a746b505 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:20.539090 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5c5f1bfe-feb4-4308-867a-5ec2a746b505 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:20.539544 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5c5f1bfe-feb4-4308-867a-5ec2a746b505 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:20.540319 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5c5f1bfe-feb4-4308-867a-5ec2a746b505 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:20.540763 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-5c5f1bfe-feb4-4308-867a-5ec2a746b505 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:20.668221 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5c5f1bfe-feb4-4308-867a-5ec2a746b505 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:20.676331 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5c5f1bfe-feb4-4308-867a-5ec2a746b505 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1555 microversion: 2.1 time: 0.148684 Jun 26 03:18:20.685584 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 540/1107] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:20 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:20.793954 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-b51f5004-ed0e-4f4e-87cb-a14fec75527b req-5af6ed3c-ae65-4acb-8186-71951e472b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad8a4d7-e228-4988-a099-a49eba183537", "name": "network-vif-plugged", "status": "completed", "tag": "8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:18:20.802740 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-b51f5004-ed0e-4f4e-87cb-a14fec75527b req-5af6ed3c-ae65-4acb-8186-71951e472b2e service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:20.803185 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-b51f5004-ed0e-4f4e-87cb-a14fec75527b req-5af6ed3c-ae65-4acb-8186-71951e472b2e service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:20.813693 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-b51f5004-ed0e-4f4e-87cb-a14fec75527b req-5af6ed3c-ae65-4acb-8186-71951e472b2e service nova] Creating event network-vif-plugged:8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf for instance dad8a4d7-e228-4988-a099-a49eba183537 on hv-cinder-84684 Jun 26 03:18:20.818428 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-b51f5004-ed0e-4f4e-87cb-a14fec75527b req-5af6ed3c-ae65-4acb-8186-71951e472b2e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084762 Jun 26 03:18:20.818992 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 568/1108] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:18:21.124582 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c1c4b586-6562-4ac7-9c96-1e161b99faf7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:21.125193 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c1c4b586-6562-4ac7-9c96-1e161b99faf7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:21.132064 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c1c4b586-6562-4ac7-9c96-1e161b99faf7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:21.132510 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c1c4b586-6562-4ac7-9c96-1e161b99faf7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:21.133266 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c1c4b586-6562-4ac7-9c96-1e161b99faf7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:21.133694 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c1c4b586-6562-4ac7-9c96-1e161b99faf7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:21.298108 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c1c4b586-6562-4ac7-9c96-1e161b99faf7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:21.306185 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c1c4b586-6562-4ac7-9c96-1e161b99faf7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1259 microversion: 2.1 time: 0.185400 Jun 26 03:18:21.306745 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 541/1109] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:21 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:21.693048 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1a78bee7-ed12-418d-9bf0-29597df0545a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:21.693746 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1a78bee7-ed12-418d-9bf0-29597df0545a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:21.699939 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1a78bee7-ed12-418d-9bf0-29597df0545a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:21.700392 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1a78bee7-ed12-418d-9bf0-29597df0545a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:21.701152 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1a78bee7-ed12-418d-9bf0-29597df0545a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:21.701593 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1a78bee7-ed12-418d-9bf0-29597df0545a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:21.830781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1a78bee7-ed12-418d-9bf0-29597df0545a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:21.838822 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1a78bee7-ed12-418d-9bf0-29597df0545a tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1555 microversion: 2.1 time: 0.149961 Jun 26 03:18:21.839442 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 569/1110] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:21 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:22.323098 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-bfc9f5fe-af68-4b75-8b12-8f8fe6f14191 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:22.323877 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-bfc9f5fe-af68-4b75-8b12-8f8fe6f14191 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:22.330537 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bfc9f5fe-af68-4b75-8b12-8f8fe6f14191 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:22.330994 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bfc9f5fe-af68-4b75-8b12-8f8fe6f14191 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:22.332417 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bfc9f5fe-af68-4b75-8b12-8f8fe6f14191 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:22.332861 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bfc9f5fe-af68-4b75-8b12-8f8fe6f14191 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:22.527572 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-bfc9f5fe-af68-4b75-8b12-8f8fe6f14191 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:22.535360 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-bfc9f5fe-af68-4b75-8b12-8f8fe6f14191 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1259 microversion: 2.1 time: 0.216142 Jun 26 03:18:22.535928 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 542/1111] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:22 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:22.615988 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-49eab58f-3bf3-4d18-9a38-5aabc2c6383e req-cc37dcfe-57c4-4bcb-91a2-3630d63123d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc861c4-11c3-4fb8-8744-9b792b9864f7", "name": "network-vif-deleted", "tag": "f6eda47f-5905-49d5-b36d-bb51bf670b9f"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:18:22.623904 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-49eab58f-3bf3-4d18-9a38-5aabc2c6383e req-cc37dcfe-57c4-4bcb-91a2-3630d63123d4 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:22.624353 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-49eab58f-3bf3-4d18-9a38-5aabc2c6383e req-cc37dcfe-57c4-4bcb-91a2-3630d63123d4 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:22.636092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-49eab58f-3bf3-4d18-9a38-5aabc2c6383e req-cc37dcfe-57c4-4bcb-91a2-3630d63123d4 service nova] Creating event network-vif-deleted:f6eda47f-5905-49d5-b36d-bb51bf670b9f for instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 on hv-cinder-84684 Jun 26 03:18:22.640776 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-49eab58f-3bf3-4d18-9a38-5aabc2c6383e req-cc37dcfe-57c4-4bcb-91a2-3630d63123d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029006 Jun 26 03:18:22.641336 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 570/1112] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:18:22.856115 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c340006a-c488-441e-aab3-718a99fdf892 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:22.856736 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c340006a-c488-441e-aab3-718a99fdf892 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:22.863357 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c340006a-c488-441e-aab3-718a99fdf892 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:22.863820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c340006a-c488-441e-aab3-718a99fdf892 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:22.864654 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c340006a-c488-441e-aab3-718a99fdf892 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:22.865103 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c340006a-c488-441e-aab3-718a99fdf892 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:22.939479 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c340006a-c488-441e-aab3-718a99fdf892 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1042fb5384e14cd2bc7090f09db977c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe0cd601688420d88ea051894cfdf2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:22.950062 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c340006a-c488-441e-aab3-718a99fdf892 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 200 len: 1513 microversion: 2.1 time: 0.097757 Jun 26 03:18:22.951474 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 543/1113] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:22 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 1513 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:23.552992 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-00b4b8bf-afd1-4dfd-8ed7-9b487a5e5c6f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:23.553688 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-00b4b8bf-afd1-4dfd-8ed7-9b487a5e5c6f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:23.560033 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00b4b8bf-afd1-4dfd-8ed7-9b487a5e5c6f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:23.560512 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00b4b8bf-afd1-4dfd-8ed7-9b487a5e5c6f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:23.561274 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00b4b8bf-afd1-4dfd-8ed7-9b487a5e5c6f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:23.561711 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-00b4b8bf-afd1-4dfd-8ed7-9b487a5e5c6f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:23.692666 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-00b4b8bf-afd1-4dfd-8ed7-9b487a5e5c6f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:23.700091 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-00b4b8bf-afd1-4dfd-8ed7-9b487a5e5c6f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1443 microversion: 2.1 time: 0.151737 Jun 26 03:18:23.700659 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 571/1114] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:23 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:23.716797 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d04d4fb3-3e37-4fd7-9951-d98cae5a3941 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:23.717415 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d04d4fb3-3e37-4fd7-9951-d98cae5a3941 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:23.723882 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d04d4fb3-3e37-4fd7-9951-d98cae5a3941 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:23.724338 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d04d4fb3-3e37-4fd7-9951-d98cae5a3941 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:23.725201 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d04d4fb3-3e37-4fd7-9951-d98cae5a3941 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:23.725790 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d04d4fb3-3e37-4fd7-9951-d98cae5a3941 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:23.860621 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d04d4fb3-3e37-4fd7-9951-d98cae5a3941 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:18:23.868718 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d04d4fb3-3e37-4fd7-9951-d98cae5a3941 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1443 microversion: 2.1 time: 0.156099 Jun 26 03:18:23.869287 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 544/1115] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:23 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:18:23.967677 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-431fdcdd-1958-4bd4-8a9a-aa2cdf7c4078 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:23.968287 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-431fdcdd-1958-4bd4-8a9a-aa2cdf7c4078 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] [instance: 1fc861c4-11c3-4fb8-8744-9b792b9864f7] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:18:23.974298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-431fdcdd-1958-4bd4-8a9a-aa2cdf7c4078 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:23.974750 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-431fdcdd-1958-4bd4-8a9a-aa2cdf7c4078 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:23.975509 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-431fdcdd-1958-4bd4-8a9a-aa2cdf7c4078 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:23.975944 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-431fdcdd-1958-4bd4-8a9a-aa2cdf7c4078 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:23.989922 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-431fdcdd-1958-4bd4-8a9a-aa2cdf7c4078 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] HTTP exception thrown: Instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 could not be found. Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-431fdcdd-1958-4bd4-8a9a-aa2cdf7c4078 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Request method failure captured: Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 HTTP/1.1 Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8748KeiQxLo6akDPqFsM0K66us2SdirHO1BCfAJ1HgBAX-N6NeCI8jTWK3Mk2USWscn8tXVNw2kiT_8VqmgESCvu4MsLMNNWH7HEJqSvuzyyh4W0JRpi33GwD11eo7btWC1obzXURN2MR8hdcuI0LXxLL0OoelpZmQRUjaXSUQRPTo Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 1fe0cd601688420d88ea051894cfdf2a Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-TestMinimumBasicScenario-268170511 Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:18:23.991965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:18:23.993619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1fe0cd601688420d88ea051894cfdf2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1fe0cd601688420d88ea051894cfdf2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fe0cd601688420d88ea051894cfdf2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1fe0cd601688420d88ea051894cfdf2a"}]}] Jun 26 03:18:23.993619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-TestMinimumBasicScenario-268170511 Jun 26 03:18:23.993619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 1fe0cd601688420d88ea051894cfdf2a Jun 26 03:18:23.993619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-TestMinimumBasicScenario-268170511 Jun 26 03:18:23.993619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-TestMinimumBasicScenario-268170511-project Jun 26 03:18:23.993619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:18:23.993619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:18:23.993619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 1042fb5384e14cd2bc7090f09db977c2 Jun 26 03:18:23.993619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-TestMinimumBasicScenario-268170511-project Jun 26 03:18:23.993619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:18:23.993619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 could not be found. Jun 26 03:18:23.993619 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '1fc861c4-11c3-4fb8-8744-9b792b9864f7'} Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 could not be found. Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:18:23.994460 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 could not be found. Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 could not be found. Jun 26 03:18:23.995742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:18:23.996916 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-431fdcdd-1958-4bd4-8a9a-aa2cdf7c4078 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Returning 404 to user: Instance 1fc861c4-11c3-4fb8-8744-9b792b9864f7 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:18:23.996916 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-431fdcdd-1958-4bd4-8a9a-aa2cdf7c4078 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7" status: 404 len: 111 microversion: 2.1 time: 0.029444 Jun 26 03:18:23.996916 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 572/1116] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:18:23 2022] GET /compute/v2.1/servers/1fc861c4-11c3-4fb8-8744-9b792b9864f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:18:24.001858 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4811bd5b-d42a-4c00-937b-21945aee0690 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] Calling method '.version_select at 0x7f58277d3dc0>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:18:24.023252 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4811bd5b-d42a-4c00-937b-21945aee0690 tempest-TestMinimumBasicScenario-268170511 tempest-TestMinimumBasicScenario-268170511-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1102567893" status: 202 len: 0 microversion: 2.1 time: 0.025069 Jun 26 03:18:24.023839 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 545/1117] 10.222.0.13 () {58 vars in 1271 bytes} [Sun Jun 26 03:18:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1102567893 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:18:25.761833 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-a4ea7954-dd78-425c-9a9d-5f7a066e4034 req-a4567df4-2228-4754-afe3-053dfbe7ca2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad8a4d7-e228-4988-a099-a49eba183537", "tag": "8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:18:25.771632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-a4ea7954-dd78-425c-9a9d-5f7a066e4034 req-a4567df4-2228-4754-afe3-053dfbe7ca2d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:18:25.772224 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-a4ea7954-dd78-425c-9a9d-5f7a066e4034 req-a4567df4-2228-4754-afe3-053dfbe7ca2d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:18:25.783711 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-a4ea7954-dd78-425c-9a9d-5f7a066e4034 req-a4567df4-2228-4754-afe3-053dfbe7ca2d service nova] Creating event network-changed:8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf for instance dad8a4d7-e228-4988-a099-a49eba183537 on hv-cinder-84684 Jun 26 03:18:25.789661 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-a4ea7954-dd78-425c-9a9d-5f7a066e4034 req-a4567df4-2228-4754-afe3-053dfbe7ca2d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031598 Jun 26 03:18:25.790814 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 573/1118] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:18:41.607073 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=94 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:18:41.608543 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:18:41.791377 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d4911594-e253-4b9f-80c4-43926a53f5a5 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Action: 'create', calling method: .version_select at 0x7f5827736c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2006413388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmPYnRZVVW/X0Snzq5c+dXtAW9PwohjReargRj+0PIK4ShH/aUHB1Ur012kybKik9adKfOxuSgnltCSY+pUW8s8RIY7oO8day70puN5JKIFhhV8flT3Ccpb0SlC1RCq6Q=="}} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:18:41.805540 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-d4911594-e253-4b9f-80c4-43926a53f5a5 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Getting quotas for project 4a6b41994f444cafb21d3d6e395b6893. Resources: {'key_pairs'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:18:41.809292 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.quota [None req-d4911594-e253-4b9f-80c4-43926a53f5a5 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Getting quotas for user 6d52b7f924f24f518ad0c9dfb6008260 and project 4a6b41994f444cafb21d3d6e395b6893. Resources: {'key_pairs'} {{(pid=117782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:18:41.831853 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d4911594-e253-4b9f-80c4-43926a53f5a5 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.225711 Jun 26 03:18:41.832458 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 546/1119] 10.222.0.13 () {60 vars in 1158 bytes} [Sun Jun 26 03:18:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:19:04.251959 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:19:04.252699 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:19:04.256886 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1816496283", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2006413388", "security_groups": [{"name": "tempest-secgroup-smoke-43239331"}], "block_device_mapping_v2": [{"uuid": "a2747ec3-8990-499c-bf3a-ad67172573dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4925de68-9c6f-4235-8c00-daee335817a4"}]}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:19:04.367124 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] validate_networks() for [('4925de68-9c6f-4235-8c00-daee335817a4', None, None, None, None, None)] {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:19:04.826481 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:19:04.826907 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:19:04.827380 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:19:04.827790 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:19:04.828205 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:19:04.837572 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:04.838025 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:04.838856 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:04.839296 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:04.856302 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Getting quotas for project 4a6b41994f444cafb21d3d6e395b6893. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:19:04.860186 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Getting quotas for user 6d52b7f924f24f518ad0c9dfb6008260 and project 4a6b41994f444cafb21d3d6e395b6893. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:19:04.916363 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:19:04.918576 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2747ec3-8990-499c-bf3a-ad67172573dd',volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:19:05.039884 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR oslo.messaging._drivers.impl_rabbit [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [6da37a4c-fb6e-4c07-b2d6-ad93d0442eb7] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 26 03:19:06.047679 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO oslo.messaging._drivers.impl_rabbit [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [6da37a4c-fb6e-4c07-b2d6-ad93d0442eb7] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60678. Jun 26 03:19:06.051903 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-26903ed8-6e68-4b66-82c2-607ce664508a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.801672 Jun 26 03:19:06.052537 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 574/1120] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:19:04 2022] POST /compute/v2.1/servers => generated 404 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:19:06.059730 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=4 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:19:06.060837 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:19:06.064674 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8e87ef11-ec0f-4c06-a739-bc696aa2f3a7 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:06.065285 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8e87ef11-ec0f-4c06-a739-bc696aa2f3a7 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:06.123112 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8e87ef11-ec0f-4c06-a739-bc696aa2f3a7 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:06.129649 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8e87ef11-ec0f-4c06-a739-bc696aa2f3a7 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1095 microversion: 2.1 time: 0.071247 Jun 26 03:19:06.130303 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 547/1121] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:06 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:07.146671 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3a7d274f-1449-4b46-a867-56315bfa7afc tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:07.147278 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3a7d274f-1449-4b46-a867-56315bfa7afc tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:07.198820 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3a7d274f-1449-4b46-a867-56315bfa7afc tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:07.205409 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3a7d274f-1449-4b46-a867-56315bfa7afc tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1095 microversion: 2.1 time: 0.062702 Jun 26 03:19:07.205963 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 575/1122] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:07 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:08.221236 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5649335a-1d71-48dc-8418-0e0b0fdeb163 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:08.221929 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-5649335a-1d71-48dc-8418-0e0b0fdeb163 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:08.276884 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-5649335a-1d71-48dc-8418-0e0b0fdeb163 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:08.283666 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5649335a-1d71-48dc-8418-0e0b0fdeb163 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1095 microversion: 2.1 time: 0.066530 Jun 26 03:19:08.284217 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 548/1123] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:08 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:09.299543 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d3469574-c076-4fdb-87db-a4ed245beb29 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:09.300150 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d3469574-c076-4fdb-87db-a4ed245beb29 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:09.354876 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d3469574-c076-4fdb-87db-a4ed245beb29 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:09.361416 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d3469574-c076-4fdb-87db-a4ed245beb29 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1095 microversion: 2.1 time: 0.065701 Jun 26 03:19:09.361980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 576/1124] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:09 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:10.378518 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-eee502bd-54dd-4a26-a448-83ea9d8cd4ef tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:10.379435 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-eee502bd-54dd-4a26-a448-83ea9d8cd4ef tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:10.387142 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eee502bd-54dd-4a26-a448-83ea9d8cd4ef tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:10.387592 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eee502bd-54dd-4a26-a448-83ea9d8cd4ef tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:10.388348 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eee502bd-54dd-4a26-a448-83ea9d8cd4ef tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:10.388782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-eee502bd-54dd-4a26-a448-83ea9d8cd4ef tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:10.452879 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-eee502bd-54dd-4a26-a448-83ea9d8cd4ef tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:10.462520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-eee502bd-54dd-4a26-a448-83ea9d8cd4ef tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1145 microversion: 2.1 time: 0.088372 Jun 26 03:19:10.463101 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 549/1125] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:10 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:11.479145 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a60dea23-bc5e-4385-b053-cde2b1e200ae tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:11.479818 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a60dea23-bc5e-4385-b053-cde2b1e200ae tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:11.486512 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a60dea23-bc5e-4385-b053-cde2b1e200ae tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:11.486972 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a60dea23-bc5e-4385-b053-cde2b1e200ae tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:11.487754 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a60dea23-bc5e-4385-b053-cde2b1e200ae tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:11.488197 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a60dea23-bc5e-4385-b053-cde2b1e200ae tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:11.571424 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a60dea23-bc5e-4385-b053-cde2b1e200ae tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:11.580121 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a60dea23-bc5e-4385-b053-cde2b1e200ae tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1211 microversion: 2.1 time: 0.104878 Jun 26 03:19:11.580705 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 577/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:11 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:12.597241 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fc9a22d7-21a2-4a75-8196-84ccd29c6daf tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:12.597865 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-fc9a22d7-21a2-4a75-8196-84ccd29c6daf tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:12.606814 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fc9a22d7-21a2-4a75-8196-84ccd29c6daf tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:12.607301 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fc9a22d7-21a2-4a75-8196-84ccd29c6daf tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:12.608005 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fc9a22d7-21a2-4a75-8196-84ccd29c6daf tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:12.608450 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-fc9a22d7-21a2-4a75-8196-84ccd29c6daf tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:12.702323 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-d3678201-6720-4344-8c8b-1b46e667be3a req-0d7fbaaf-288d-457f-b420-ca022269ba73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1ffc28-1390-49e3-89a2-0e9d284b2321", "tag": "a55b8d34-2a58-424c-9e6a-07ac0e4655c7"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:19:12.718696 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-d3678201-6720-4344-8c8b-1b46e667be3a req-0d7fbaaf-288d-457f-b420-ca022269ba73 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:12.719148 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-d3678201-6720-4344-8c8b-1b46e667be3a req-0d7fbaaf-288d-457f-b420-ca022269ba73 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:12.735427 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-d3678201-6720-4344-8c8b-1b46e667be3a req-0d7fbaaf-288d-457f-b420-ca022269ba73 service nova] Creating event network-changed:a55b8d34-2a58-424c-9e6a-07ac0e4655c7 for instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 on hv-cinder-84684 Jun 26 03:19:12.741525 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-d3678201-6720-4344-8c8b-1b46e667be3a req-0d7fbaaf-288d-457f-b420-ca022269ba73 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049330 Jun 26 03:19:12.742160 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 578/1127] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:19:12.811455 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-fc9a22d7-21a2-4a75-8196-84ccd29c6daf tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:12.819796 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-fc9a22d7-21a2-4a75-8196-84ccd29c6daf tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1265 microversion: 2.1 time: 0.225827 Jun 26 03:19:12.820375 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 550/1128] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:12 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:13.837584 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a34222da-5d55-47a4-9db6-6e445f878f41 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:13.838316 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a34222da-5d55-47a4-9db6-6e445f878f41 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:13.844849 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a34222da-5d55-47a4-9db6-6e445f878f41 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:13.845298 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a34222da-5d55-47a4-9db6-6e445f878f41 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:13.846066 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a34222da-5d55-47a4-9db6-6e445f878f41 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:13.846510 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a34222da-5d55-47a4-9db6-6e445f878f41 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:14.033762 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a34222da-5d55-47a4-9db6-6e445f878f41 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:14.041169 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a34222da-5d55-47a4-9db6-6e445f878f41 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1265 microversion: 2.1 time: 0.208249 Jun 26 03:19:14.041944 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 579/1129] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:13 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:15.058488 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d9c6eae5-5a28-48e5-846c-9652fe57d3a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:15.059101 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d9c6eae5-5a28-48e5-846c-9652fe57d3a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:15.065237 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d9c6eae5-5a28-48e5-846c-9652fe57d3a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:15.065691 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d9c6eae5-5a28-48e5-846c-9652fe57d3a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:15.066497 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d9c6eae5-5a28-48e5-846c-9652fe57d3a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:15.066935 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d9c6eae5-5a28-48e5-846c-9652fe57d3a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:15.196549 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d9c6eae5-5a28-48e5-846c-9652fe57d3a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:15.203820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d9c6eae5-5a28-48e5-846c-9652fe57d3a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1265 microversion: 2.1 time: 0.149341 Jun 26 03:19:15.204387 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 551/1130] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:15 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:16.219875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-03f22710-0903-4d94-9d31-84f085b2b447 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:16.220470 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-03f22710-0903-4d94-9d31-84f085b2b447 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:16.223160 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=2 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:19:16.229201 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-03f22710-0903-4d94-9d31-84f085b2b447 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:16.229673 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-03f22710-0903-4d94-9d31-84f085b2b447 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:16.230488 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-03f22710-0903-4d94-9d31-84f085b2b447 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:16.230908 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-03f22710-0903-4d94-9d31-84f085b2b447 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:16.364255 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-03f22710-0903-4d94-9d31-84f085b2b447 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:16.372390 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-03f22710-0903-4d94-9d31-84f085b2b447 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1265 microversion: 2.1 time: 0.156318 Jun 26 03:19:16.372956 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 580/1131] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:16 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:17.388917 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-60508587-3156-45ff-ac93-19f91bb71751 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:17.389529 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-60508587-3156-45ff-ac93-19f91bb71751 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:17.396079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-60508587-3156-45ff-ac93-19f91bb71751 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:17.396534 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-60508587-3156-45ff-ac93-19f91bb71751 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:17.397895 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-60508587-3156-45ff-ac93-19f91bb71751 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:17.398368 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-60508587-3156-45ff-ac93-19f91bb71751 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:17.532261 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-60508587-3156-45ff-ac93-19f91bb71751 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:17.539679 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-60508587-3156-45ff-ac93-19f91bb71751 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1265 microversion: 2.1 time: 0.154672 Jun 26 03:19:17.540260 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 552/1132] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:17 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:18.556113 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-aaf909ea-3bac-41d5-8431-147f33daf5cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:18.556701 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-aaf909ea-3bac-41d5-8431-147f33daf5cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:18.563227 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-aaf909ea-3bac-41d5-8431-147f33daf5cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:18.563677 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-aaf909ea-3bac-41d5-8431-147f33daf5cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:18.564434 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-aaf909ea-3bac-41d5-8431-147f33daf5cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:18.564867 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-aaf909ea-3bac-41d5-8431-147f33daf5cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:18.691167 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-aaf909ea-3bac-41d5-8431-147f33daf5cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:18.699016 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-aaf909ea-3bac-41d5-8431-147f33daf5cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1265 microversion: 2.1 time: 0.146876 Jun 26 03:19:18.699573 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 581/1133] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:18 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:19.715761 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-cd3d6caa-9d0f-49f9-8c79-4693f97849d8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:19.716416 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-cd3d6caa-9d0f-49f9-8c79-4693f97849d8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:19.718222 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=4 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:19:19.723846 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cd3d6caa-9d0f-49f9-8c79-4693f97849d8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:19.724277 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cd3d6caa-9d0f-49f9-8c79-4693f97849d8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:19.725601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cd3d6caa-9d0f-49f9-8c79-4693f97849d8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:19.726067 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-cd3d6caa-9d0f-49f9-8c79-4693f97849d8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:19.857046 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-cd3d6caa-9d0f-49f9-8c79-4693f97849d8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:19.864431 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-cd3d6caa-9d0f-49f9-8c79-4693f97849d8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1265 microversion: 2.1 time: 0.152525 Jun 26 03:19:19.864988 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 553/1134] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:19 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:20.880662 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-20c255de-6f8d-4503-99b5-ea78d5046871 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:20.881273 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-20c255de-6f8d-4503-99b5-ea78d5046871 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:20.883417 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=10 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:19:20.889378 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-20c255de-6f8d-4503-99b5-ea78d5046871 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:20.889833 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-20c255de-6f8d-4503-99b5-ea78d5046871 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:20.890632 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-20c255de-6f8d-4503-99b5-ea78d5046871 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:20.891337 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-20c255de-6f8d-4503-99b5-ea78d5046871 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:21.020991 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-20c255de-6f8d-4503-99b5-ea78d5046871 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:21.028868 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-20c255de-6f8d-4503-99b5-ea78d5046871 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1265 microversion: 2.1 time: 0.152106 Jun 26 03:19:21.029441 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 582/1135] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:20 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:22.099569 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a70a246b-caa8-4726-8b35-96b7eb7381d6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:22.100081 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a70a246b-caa8-4726-8b35-96b7eb7381d6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:22.106491 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a70a246b-caa8-4726-8b35-96b7eb7381d6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:22.106938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a70a246b-caa8-4726-8b35-96b7eb7381d6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:22.107691 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a70a246b-caa8-4726-8b35-96b7eb7381d6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:22.108157 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a70a246b-caa8-4726-8b35-96b7eb7381d6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:22.238413 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a70a246b-caa8-4726-8b35-96b7eb7381d6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:22.246256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a70a246b-caa8-4726-8b35-96b7eb7381d6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1265 microversion: 2.1 time: 0.150503 Jun 26 03:19:22.246812 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 554/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:22 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:23.021065 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-39c1205b-cc83-450a-b494-0ccef90d332c req-7db3504a-2297-43ad-83e5-9a4db7439f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1ffc28-1390-49e3-89a2-0e9d284b2321", "name": "network-vif-plugged", "status": "completed", "tag": "a55b8d34-2a58-424c-9e6a-07ac0e4655c7"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:19:23.030549 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-39c1205b-cc83-450a-b494-0ccef90d332c req-7db3504a-2297-43ad-83e5-9a4db7439f2b service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:23.031055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-39c1205b-cc83-450a-b494-0ccef90d332c req-7db3504a-2297-43ad-83e5-9a4db7439f2b service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:23.043315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-39c1205b-cc83-450a-b494-0ccef90d332c req-7db3504a-2297-43ad-83e5-9a4db7439f2b service nova] Creating event network-vif-plugged:a55b8d34-2a58-424c-9e6a-07ac0e4655c7 for instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 on hv-cinder-84684 Jun 26 03:19:23.048548 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-39c1205b-cc83-450a-b494-0ccef90d332c req-7db3504a-2297-43ad-83e5-9a4db7439f2b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031149 Jun 26 03:19:23.049129 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 583/1137] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:19:23.263570 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-563f37ac-0ab2-4cac-9a65-606278c95ccd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:23.264192 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-563f37ac-0ab2-4cac-9a65-606278c95ccd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:23.270842 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-563f37ac-0ab2-4cac-9a65-606278c95ccd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:23.271300 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-563f37ac-0ab2-4cac-9a65-606278c95ccd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:23.272640 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-563f37ac-0ab2-4cac-9a65-606278c95ccd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:23.273087 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-563f37ac-0ab2-4cac-9a65-606278c95ccd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:23.428831 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-563f37ac-0ab2-4cac-9a65-606278c95ccd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:23.436285 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-563f37ac-0ab2-4cac-9a65-606278c95ccd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1265 microversion: 2.1 time: 0.176554 Jun 26 03:19:23.436866 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 555/1138] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:23 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:19:24.454408 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-fb4d027a-3c7b-4163-9b7f-0389acfa8371 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:24.455104 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-fb4d027a-3c7b-4163-9b7f-0389acfa8371 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:24.461671 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb4d027a-3c7b-4163-9b7f-0389acfa8371 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:24.462148 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb4d027a-3c7b-4163-9b7f-0389acfa8371 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:24.462896 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb4d027a-3c7b-4163-9b7f-0389acfa8371 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:24.463327 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-fb4d027a-3c7b-4163-9b7f-0389acfa8371 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:24.594962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-fb4d027a-3c7b-4163-9b7f-0389acfa8371 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:24.603351 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-fb4d027a-3c7b-4163-9b7f-0389acfa8371 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1265 microversion: 2.1 time: 0.153639 Jun 26 03:19:24.603920 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 584/1139] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:24 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:25.620522 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8e92023f-18ed-489e-89df-04527a00f981 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:25.621142 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8e92023f-18ed-489e-89df-04527a00f981 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:25.627576 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8e92023f-18ed-489e-89df-04527a00f981 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:25.628061 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8e92023f-18ed-489e-89df-04527a00f981 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:25.628824 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8e92023f-18ed-489e-89df-04527a00f981 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:25.629297 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8e92023f-18ed-489e-89df-04527a00f981 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:25.756326 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8e92023f-18ed-489e-89df-04527a00f981 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:25.763964 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8e92023f-18ed-489e-89df-04527a00f981 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1451 microversion: 2.1 time: 0.147333 Jun 26 03:19:25.764525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 556/1140] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:25 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:25.780193 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-e475421d-885c-46ef-9e01-6782f4b1b473 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:19:25.780814 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-e475421d-885c-46ef-9e01-6782f4b1b473 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:19:25.787200 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e475421d-885c-46ef-9e01-6782f4b1b473 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:25.788193 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e475421d-885c-46ef-9e01-6782f4b1b473 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:25.788957 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e475421d-885c-46ef-9e01-6782f4b1b473 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:25.789397 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-e475421d-885c-46ef-9e01-6782f4b1b473 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:25.916844 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-e475421d-885c-46ef-9e01-6782f4b1b473 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:19:25.924374 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-e475421d-885c-46ef-9e01-6782f4b1b473 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1451 microversion: 2.1 time: 0.147982 Jun 26 03:19:25.924943 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 585/1141] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:19:25 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:19:27.748632 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-44e20532-4eda-42a0-a0bb-b4c3e61ecaf6 req-c1ba7f12-f061-495f-8d3b-57be38956b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1ffc28-1390-49e3-89a2-0e9d284b2321", "tag": "a55b8d34-2a58-424c-9e6a-07ac0e4655c7"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:19:27.758111 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-44e20532-4eda-42a0-a0bb-b4c3e61ecaf6 req-c1ba7f12-f061-495f-8d3b-57be38956b0b service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:19:27.758558 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-44e20532-4eda-42a0-a0bb-b4c3e61ecaf6 req-c1ba7f12-f061-495f-8d3b-57be38956b0b service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:19:27.769662 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-44e20532-4eda-42a0-a0bb-b4c3e61ecaf6 req-c1ba7f12-f061-495f-8d3b-57be38956b0b service nova] Creating event network-changed:a55b8d34-2a58-424c-9e6a-07ac0e4655c7 for instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 on hv-cinder-84684 Jun 26 03:19:27.775447 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-44e20532-4eda-42a0-a0bb-b4c3e61ecaf6 req-c1ba7f12-f061-495f-8d3b-57be38956b0b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030555 Jun 26 03:19:27.776056 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 557/1142] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:20:50.024758 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:50.025501 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=48 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:50.029660 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-81639719-58f0-4fe7-938e-7abd68308c36 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:20:50.030221 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-81639719-58f0-4fe7-938e-7abd68308c36 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:20:50.037590 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-81639719-58f0-4fe7-938e-7abd68308c36 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:50.038034 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-81639719-58f0-4fe7-938e-7abd68308c36 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:50.038805 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-81639719-58f0-4fe7-938e-7abd68308c36 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:50.039238 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-81639719-58f0-4fe7-938e-7abd68308c36 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:50.062322 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.objects.instance [None req-81639719-58f0-4fe7-938e-7abd68308c36 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lazy-loading 'flavor' on Instance uuid dad8a4d7-e228-4988-a099-a49eba183537 {{(pid=117783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:20:50.131714 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-81639719-58f0-4fe7-938e-7abd68308c36 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "POST /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537/action" status: 202 len: 0 microversion: 2.1 time: 0.108707 Jun 26 03:20:50.132296 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 586/1143] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:20:50 2022] POST /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:20:50.139179 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=26 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:50.139913 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=50 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:50.145049 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-44bfabcf-21cf-47ff-bf54-1138d8f711de tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:20:50.145753 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-44bfabcf-21cf-47ff-bf54-1138d8f711de tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:20:50.154627 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-44bfabcf-21cf-47ff-bf54-1138d8f711de tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:50.155080 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-44bfabcf-21cf-47ff-bf54-1138d8f711de tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:50.155856 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-44bfabcf-21cf-47ff-bf54-1138d8f711de tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:50.156290 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-44bfabcf-21cf-47ff-bf54-1138d8f711de tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:50.363406 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-44bfabcf-21cf-47ff-bf54-1138d8f711de tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:20:50.370894 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-44bfabcf-21cf-47ff-bf54-1138d8f711de tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1568 microversion: 2.1 time: 0.233846 Jun 26 03:20:50.371453 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 558/1144] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:20:50 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:20:51.389518 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-14134b24-fd2f-4815-9849-b508c99e9b22 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:20:51.390245 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-14134b24-fd2f-4815-9849-b508c99e9b22 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:20:51.396357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-14134b24-fd2f-4815-9849-b508c99e9b22 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:51.396809 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-14134b24-fd2f-4815-9849-b508c99e9b22 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:51.397570 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-14134b24-fd2f-4815-9849-b508c99e9b22 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:51.398007 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-14134b24-fd2f-4815-9849-b508c99e9b22 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:51.576507 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-14134b24-fd2f-4815-9849-b508c99e9b22 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:20:51.584159 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-14134b24-fd2f-4815-9849-b508c99e9b22 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1568 microversion: 2.1 time: 0.200343 Jun 26 03:20:51.584728 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 587/1145] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:20:51 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:20:52.600766 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c64be0f6-2f90-4563-aa8d-41ff67e5f316 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:20:52.601305 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c64be0f6-2f90-4563-aa8d-41ff67e5f316 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:20:52.608479 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c64be0f6-2f90-4563-aa8d-41ff67e5f316 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:52.608932 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c64be0f6-2f90-4563-aa8d-41ff67e5f316 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:52.609705 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c64be0f6-2f90-4563-aa8d-41ff67e5f316 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:52.610175 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c64be0f6-2f90-4563-aa8d-41ff67e5f316 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:52.741515 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c64be0f6-2f90-4563-aa8d-41ff67e5f316 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:20:52.748994 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c64be0f6-2f90-4563-aa8d-41ff67e5f316 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1568 microversion: 2.1 time: 0.152228 Jun 26 03:20:52.749555 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 559/1146] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:20:52 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:20:53.765900 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6029efad-1e28-4297-8482-855f95c4684f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:20:53.766540 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-6029efad-1e28-4297-8482-855f95c4684f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:20:53.773013 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6029efad-1e28-4297-8482-855f95c4684f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:53.773469 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6029efad-1e28-4297-8482-855f95c4684f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:53.774273 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6029efad-1e28-4297-8482-855f95c4684f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:53.775357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6029efad-1e28-4297-8482-855f95c4684f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:53.902958 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6029efad-1e28-4297-8482-855f95c4684f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:20:53.910316 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6029efad-1e28-4297-8482-855f95c4684f tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1568 microversion: 2.1 time: 0.148239 Jun 26 03:20:53.910872 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 588/1147] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:20:53 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:20:54.927352 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ff34ab62-5568-4411-97ef-9b13f30eb82a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:20:54.927967 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ff34ab62-5568-4411-97ef-9b13f30eb82a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:20:54.934434 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ff34ab62-5568-4411-97ef-9b13f30eb82a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:54.934887 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ff34ab62-5568-4411-97ef-9b13f30eb82a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:54.935649 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ff34ab62-5568-4411-97ef-9b13f30eb82a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:54.936092 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ff34ab62-5568-4411-97ef-9b13f30eb82a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:55.066122 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ff34ab62-5568-4411-97ef-9b13f30eb82a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:20:55.073490 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ff34ab62-5568-4411-97ef-9b13f30eb82a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1568 microversion: 2.1 time: 0.150012 Jun 26 03:20:55.074059 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 560/1148] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:20:54 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:20:56.090640 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9f75f7d1-4732-4abf-b214-c1d6a18099a1 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:20:56.091274 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9f75f7d1-4732-4abf-b214-c1d6a18099a1 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:20:56.097675 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9f75f7d1-4732-4abf-b214-c1d6a18099a1 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:56.098140 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9f75f7d1-4732-4abf-b214-c1d6a18099a1 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:56.098899 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9f75f7d1-4732-4abf-b214-c1d6a18099a1 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:56.099335 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9f75f7d1-4732-4abf-b214-c1d6a18099a1 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:56.225289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9f75f7d1-4732-4abf-b214-c1d6a18099a1 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:20:56.233246 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9f75f7d1-4732-4abf-b214-c1d6a18099a1 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1568 microversion: 2.1 time: 0.146513 Jun 26 03:20:56.233800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 589/1149] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:20:56 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:20:57.250206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-07469d9a-bdd7-443a-b2c5-c174bd87b550 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:20:57.250827 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-07469d9a-bdd7-443a-b2c5-c174bd87b550 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:20:57.257376 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-07469d9a-bdd7-443a-b2c5-c174bd87b550 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:57.257861 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-07469d9a-bdd7-443a-b2c5-c174bd87b550 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:57.258914 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-07469d9a-bdd7-443a-b2c5-c174bd87b550 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:57.259349 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-07469d9a-bdd7-443a-b2c5-c174bd87b550 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:57.388168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-07469d9a-bdd7-443a-b2c5-c174bd87b550 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:20:57.395617 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-07469d9a-bdd7-443a-b2c5-c174bd87b550 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1568 microversion: 2.1 time: 0.149325 Jun 26 03:20:57.396174 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 561/1150] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:20:57 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:20:58.412807 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d0f60c8d-2911-4ff7-8503-b98f106f13d4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:20:58.413423 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d0f60c8d-2911-4ff7-8503-b98f106f13d4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:20:58.419655 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d0f60c8d-2911-4ff7-8503-b98f106f13d4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:58.420112 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d0f60c8d-2911-4ff7-8503-b98f106f13d4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:58.420885 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d0f60c8d-2911-4ff7-8503-b98f106f13d4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:58.421349 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d0f60c8d-2911-4ff7-8503-b98f106f13d4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:58.550190 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d0f60c8d-2911-4ff7-8503-b98f106f13d4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:20:58.558150 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d0f60c8d-2911-4ff7-8503-b98f106f13d4 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1568 microversion: 2.1 time: 0.149332 Jun 26 03:20:58.558709 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 590/1151] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:20:58 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:20:59.575024 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e814f253-0997-4d1d-8af6-56d5fe26321e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:20:59.575638 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e814f253-0997-4d1d-8af6-56d5fe26321e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:20:59.582070 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e814f253-0997-4d1d-8af6-56d5fe26321e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:59.582525 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e814f253-0997-4d1d-8af6-56d5fe26321e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:59.583286 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e814f253-0997-4d1d-8af6-56d5fe26321e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:20:59.583724 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e814f253-0997-4d1d-8af6-56d5fe26321e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:20:59.709813 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e814f253-0997-4d1d-8af6-56d5fe26321e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:20:59.717806 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e814f253-0997-4d1d-8af6-56d5fe26321e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1568 microversion: 2.1 time: 0.146663 Jun 26 03:20:59.718396 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 562/1152] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:20:59 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:00.734578 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-79ee8ec8-1bf8-4404-b9c7-14f4944cdbb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:00.735186 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-79ee8ec8-1bf8-4404-b9c7-14f4944cdbb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:00.741658 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-79ee8ec8-1bf8-4404-b9c7-14f4944cdbb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:00.742243 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-79ee8ec8-1bf8-4404-b9c7-14f4944cdbb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:00.743050 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-79ee8ec8-1bf8-4404-b9c7-14f4944cdbb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:00.743492 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-79ee8ec8-1bf8-4404-b9c7-14f4944cdbb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:00.941349 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-79ee8ec8-1bf8-4404-b9c7-14f4944cdbb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:00.949777 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-79ee8ec8-1bf8-4404-b9c7-14f4944cdbb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1568 microversion: 2.1 time: 0.218949 Jun 26 03:21:00.950393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 591/1153] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:00 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:01.967912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-16dae260-2a1c-4a67-9112-1928f62e1c7d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:01.968530 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-16dae260-2a1c-4a67-9112-1928f62e1c7d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:01.975117 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-16dae260-2a1c-4a67-9112-1928f62e1c7d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:01.975569 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-16dae260-2a1c-4a67-9112-1928f62e1c7d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:01.976332 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-16dae260-2a1c-4a67-9112-1928f62e1c7d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:01.976772 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-16dae260-2a1c-4a67-9112-1928f62e1c7d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:02.104520 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-16dae260-2a1c-4a67-9112-1928f62e1c7d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:02.112044 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-16dae260-2a1c-4a67-9112-1928f62e1c7d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1568 microversion: 2.1 time: 0.147929 Jun 26 03:21:02.112654 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 563/1154] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:01 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:03.129662 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-bc56a5e8-27a7-4c8b-8a25-494ba4cca8c2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:03.130293 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-bc56a5e8-27a7-4c8b-8a25-494ba4cca8c2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:03.137589 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc56a5e8-27a7-4c8b-8a25-494ba4cca8c2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:03.138056 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc56a5e8-27a7-4c8b-8a25-494ba4cca8c2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:03.138917 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc56a5e8-27a7-4c8b-8a25-494ba4cca8c2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:03.139350 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bc56a5e8-27a7-4c8b-8a25-494ba4cca8c2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:03.277284 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-bc56a5e8-27a7-4c8b-8a25-494ba4cca8c2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:03.284776 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-bc56a5e8-27a7-4c8b-8a25-494ba4cca8c2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1569 microversion: 2.1 time: 0.159117 Jun 26 03:21:03.285339 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 592/1155] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:03 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:21:03.300633 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c6456e31-4817-4578-bf54-13f978d44eb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:21:03.301194 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c6456e31-4817-4578-bf54-13f978d44eb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:03.308057 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c6456e31-4817-4578-bf54-13f978d44eb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:03.308504 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c6456e31-4817-4578-bf54-13f978d44eb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:03.309258 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c6456e31-4817-4578-bf54-13f978d44eb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:03.309691 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c6456e31-4817-4578-bf54-13f978d44eb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:03.397534 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c6456e31-4817-4578-bf54-13f978d44eb5 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "POST /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537/action" status: 202 len: 0 microversion: 2.1 time: 0.100297 Jun 26 03:21:03.398168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 564/1156] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Jun 26 03:21:03 2022] POST /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:21:03.406305 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9cdcc265-c43e-4871-8b3c-00bda7e4a656 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:03.406922 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9cdcc265-c43e-4871-8b3c-00bda7e4a656 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:03.412943 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9cdcc265-c43e-4871-8b3c-00bda7e4a656 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:03.413397 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9cdcc265-c43e-4871-8b3c-00bda7e4a656 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:03.414243 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9cdcc265-c43e-4871-8b3c-00bda7e4a656 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:03.414738 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9cdcc265-c43e-4871-8b3c-00bda7e4a656 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:03.558836 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9cdcc265-c43e-4871-8b3c-00bda7e4a656 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:03.566432 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9cdcc265-c43e-4871-8b3c-00bda7e4a656 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1577 microversion: 2.1 time: 0.164129 Jun 26 03:21:03.567001 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 593/1157] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:03 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:04.583868 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-95f5fc0d-a658-492f-a65c-b181c0778d60 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:04.584561 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-95f5fc0d-a658-492f-a65c-b181c0778d60 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:04.591058 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-95f5fc0d-a658-492f-a65c-b181c0778d60 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:04.591501 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-95f5fc0d-a658-492f-a65c-b181c0778d60 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:04.592268 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-95f5fc0d-a658-492f-a65c-b181c0778d60 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:04.592707 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-95f5fc0d-a658-492f-a65c-b181c0778d60 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:04.974146 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-95f5fc0d-a658-492f-a65c-b181c0778d60 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:04.982714 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-95f5fc0d-a658-492f-a65c-b181c0778d60 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1519 microversion: 2.1 time: 0.402861 Jun 26 03:21:04.983304 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 565/1158] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:04 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1519 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:05.618079 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-e5987b7b-78f9-43e3-abbe-ead68c83d95e req-4af2d1a9-246d-4008-adfd-146e8e897a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad8a4d7-e228-4988-a099-a49eba183537", "name": "network-vif-unplugged", "status": "completed", "tag": "8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:21:05.626721 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-e5987b7b-78f9-43e3-abbe-ead68c83d95e req-4af2d1a9-246d-4008-adfd-146e8e897a4b service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:05.627171 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-e5987b7b-78f9-43e3-abbe-ead68c83d95e req-4af2d1a9-246d-4008-adfd-146e8e897a4b service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:05.642111 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-e5987b7b-78f9-43e3-abbe-ead68c83d95e req-4af2d1a9-246d-4008-adfd-146e8e897a4b service nova] Creating event network-vif-unplugged:8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf for instance dad8a4d7-e228-4988-a099-a49eba183537 on hv-cinder-84684 Jun 26 03:21:05.647141 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-e5987b7b-78f9-43e3-abbe-ead68c83d95e req-4af2d1a9-246d-4008-adfd-146e8e897a4b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032681 Jun 26 03:21:05.647734 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 594/1159] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:21:06.000064 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b94d807e-6890-4fd3-ba7f-3842ce9b07ce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:06.000689 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b94d807e-6890-4fd3-ba7f-3842ce9b07ce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:06.007070 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b94d807e-6890-4fd3-ba7f-3842ce9b07ce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:06.007522 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b94d807e-6890-4fd3-ba7f-3842ce9b07ce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:06.008294 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b94d807e-6890-4fd3-ba7f-3842ce9b07ce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:06.008974 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b94d807e-6890-4fd3-ba7f-3842ce9b07ce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:06.138339 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b94d807e-6890-4fd3-ba7f-3842ce9b07ce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:06.145765 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b94d807e-6890-4fd3-ba7f-3842ce9b07ce tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1575 microversion: 2.1 time: 0.149832 Jun 26 03:21:06.146460 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 566/1160] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:05 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:07.163742 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-713fd534-b2a6-4f0a-b874-291a796e27ae tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:07.164446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-713fd534-b2a6-4f0a-b874-291a796e27ae tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:07.171304 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-713fd534-b2a6-4f0a-b874-291a796e27ae tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:07.171757 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-713fd534-b2a6-4f0a-b874-291a796e27ae tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:07.172514 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-713fd534-b2a6-4f0a-b874-291a796e27ae tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:07.172953 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-713fd534-b2a6-4f0a-b874-291a796e27ae tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:07.306374 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-713fd534-b2a6-4f0a-b874-291a796e27ae tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:07.313874 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-713fd534-b2a6-4f0a-b874-291a796e27ae tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1575 microversion: 2.1 time: 0.154766 Jun 26 03:21:07.314472 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 595/1161] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:07 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:08.331822 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-24f72cc3-f799-43ad-8a7b-9e351bc4e72e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:08.332491 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-24f72cc3-f799-43ad-8a7b-9e351bc4e72e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:08.339438 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-24f72cc3-f799-43ad-8a7b-9e351bc4e72e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:08.339887 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-24f72cc3-f799-43ad-8a7b-9e351bc4e72e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:08.340648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-24f72cc3-f799-43ad-8a7b-9e351bc4e72e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:08.341085 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-24f72cc3-f799-43ad-8a7b-9e351bc4e72e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:08.468527 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-24f72cc3-f799-43ad-8a7b-9e351bc4e72e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:08.475897 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-24f72cc3-f799-43ad-8a7b-9e351bc4e72e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1575 microversion: 2.1 time: 0.147995 Jun 26 03:21:08.476461 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 567/1162] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:08 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:09.494368 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-087b0baf-783a-4212-87aa-6b0e6d767dc6 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:09.494983 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-087b0baf-783a-4212-87aa-6b0e6d767dc6 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:09.501361 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-087b0baf-783a-4212-87aa-6b0e6d767dc6 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:09.501813 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-087b0baf-783a-4212-87aa-6b0e6d767dc6 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:09.502605 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-087b0baf-783a-4212-87aa-6b0e6d767dc6 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:09.503040 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-087b0baf-783a-4212-87aa-6b0e6d767dc6 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:09.634474 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-087b0baf-783a-4212-87aa-6b0e6d767dc6 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:09.641791 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-087b0baf-783a-4212-87aa-6b0e6d767dc6 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1575 microversion: 2.1 time: 0.151929 Jun 26 03:21:09.642376 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 596/1163] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:09 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:10.658641 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4a079c92-c02c-46ea-b92c-1c5791031016 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:10.659230 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4a079c92-c02c-46ea-b92c-1c5791031016 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:10.665676 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4a079c92-c02c-46ea-b92c-1c5791031016 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:10.666162 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4a079c92-c02c-46ea-b92c-1c5791031016 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:10.666933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4a079c92-c02c-46ea-b92c-1c5791031016 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:10.667372 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4a079c92-c02c-46ea-b92c-1c5791031016 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:10.794699 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4a079c92-c02c-46ea-b92c-1c5791031016 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:10.802123 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4a079c92-c02c-46ea-b92c-1c5791031016 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1575 microversion: 2.1 time: 0.147334 Jun 26 03:21:10.802692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 568/1164] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:10 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:11.819485 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8a062eb8-e39d-4c27-9c2f-d6b590d0a06a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:11.820020 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8a062eb8-e39d-4c27-9c2f-d6b590d0a06a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:11.826592 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8a062eb8-e39d-4c27-9c2f-d6b590d0a06a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:11.827041 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8a062eb8-e39d-4c27-9c2f-d6b590d0a06a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:11.827800 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8a062eb8-e39d-4c27-9c2f-d6b590d0a06a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:11.828230 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8a062eb8-e39d-4c27-9c2f-d6b590d0a06a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:11.961455 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-8a062eb8-e39d-4c27-9c2f-d6b590d0a06a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:11.968897 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8a062eb8-e39d-4c27-9c2f-d6b590d0a06a tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1575 microversion: 2.1 time: 0.153337 Jun 26 03:21:11.969466 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 597/1165] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:11 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:12.986748 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a9318d6f-9b2f-4fbd-959e-fe9520b743b7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:12.987272 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a9318d6f-9b2f-4fbd-959e-fe9520b743b7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:12.994523 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a9318d6f-9b2f-4fbd-959e-fe9520b743b7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:12.994967 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a9318d6f-9b2f-4fbd-959e-fe9520b743b7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:12.995722 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a9318d6f-9b2f-4fbd-959e-fe9520b743b7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:12.996156 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a9318d6f-9b2f-4fbd-959e-fe9520b743b7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:13.122598 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a9318d6f-9b2f-4fbd-959e-fe9520b743b7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:13.129872 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a9318d6f-9b2f-4fbd-959e-fe9520b743b7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1575 microversion: 2.1 time: 0.147079 Jun 26 03:21:13.130457 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 569/1166] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:12 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:14.147794 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-a72707e6-f5fc-4f31-9d43-349510e3f37d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:14.148416 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-a72707e6-f5fc-4f31-9d43-349510e3f37d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:14.155605 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a72707e6-f5fc-4f31-9d43-349510e3f37d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:14.156066 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a72707e6-f5fc-4f31-9d43-349510e3f37d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:14.156844 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a72707e6-f5fc-4f31-9d43-349510e3f37d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:14.157289 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-a72707e6-f5fc-4f31-9d43-349510e3f37d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:14.289119 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-a72707e6-f5fc-4f31-9d43-349510e3f37d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:14.296651 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-a72707e6-f5fc-4f31-9d43-349510e3f37d tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1575 microversion: 2.1 time: 0.152782 Jun 26 03:21:14.297226 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 598/1167] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:14 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:21:15.314285 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8c12deb2-56bd-4d0c-9f12-666c0cf4afe7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:15.314898 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8c12deb2-56bd-4d0c-9f12-666c0cf4afe7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:15.320938 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8c12deb2-56bd-4d0c-9f12-666c0cf4afe7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:15.321397 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8c12deb2-56bd-4d0c-9f12-666c0cf4afe7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:15.322197 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8c12deb2-56bd-4d0c-9f12-666c0cf4afe7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:15.322647 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8c12deb2-56bd-4d0c-9f12-666c0cf4afe7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:15.450827 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8c12deb2-56bd-4d0c-9f12-666c0cf4afe7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:15.458361 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8c12deb2-56bd-4d0c-9f12-666c0cf4afe7 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1562 microversion: 2.1 time: 0.148138 Jun 26 03:21:15.458930 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 570/1168] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:15 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:15.690936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-bcda09d1-de84-45d0-b046-0b33bcdf3893 req-43eb322a-415a-4672-ba54-5018dcb83257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad8a4d7-e228-4988-a099-a49eba183537", "name": "network-vif-plugged", "status": "completed", "tag": "8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:21:15.699854 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-bcda09d1-de84-45d0-b046-0b33bcdf3893 req-43eb322a-415a-4672-ba54-5018dcb83257 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:15.700391 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-bcda09d1-de84-45d0-b046-0b33bcdf3893 req-43eb322a-415a-4672-ba54-5018dcb83257 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:15.711652 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-bcda09d1-de84-45d0-b046-0b33bcdf3893 req-43eb322a-415a-4672-ba54-5018dcb83257 service nova] Creating event network-vif-plugged:8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf for instance dad8a4d7-e228-4988-a099-a49eba183537 on hv-cinder-84684 Jun 26 03:21:15.717195 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-bcda09d1-de84-45d0-b046-0b33bcdf3893 req-43eb322a-415a-4672-ba54-5018dcb83257 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029910 Jun 26 03:21:15.717783 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 599/1169] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:21:22.731661 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:21:22.732244 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Sun Jun 26 03:21:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:21:41.549749 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-7d97dc0b-0d72-4df0-bb71-4bdc5e14c68e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:41.550512 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7d97dc0b-0d72-4df0-bb71-4bdc5e14c68e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:41.552716 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=28 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:41.553374 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:41.558941 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7d97dc0b-0d72-4df0-bb71-4bdc5e14c68e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:41.559391 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7d97dc0b-0d72-4df0-bb71-4bdc5e14c68e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:41.560154 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7d97dc0b-0d72-4df0-bb71-4bdc5e14c68e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:41.560592 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-7d97dc0b-0d72-4df0-bb71-4bdc5e14c68e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:41.588256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-7d97dc0b-0d72-4df0-bb71-4bdc5e14c68e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Going to try to terminate instance {{(pid=117782) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:21:41.661012 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-7d97dc0b-0d72-4df0-bb71-4bdc5e14c68e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 204 len: 0 microversion: 2.1 time: 0.114835 Jun 26 03:21:41.661752 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 571/1170] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:21:41 2022] DELETE /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:21:41.667720 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=28 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:41.668464 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:41.672701 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1b70f563-57b9-42bb-8602-8d56d1325f1a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:41.673618 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1b70f563-57b9-42bb-8602-8d56d1325f1a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:41.681421 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1b70f563-57b9-42bb-8602-8d56d1325f1a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:41.681877 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1b70f563-57b9-42bb-8602-8d56d1325f1a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:41.682681 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1b70f563-57b9-42bb-8602-8d56d1325f1a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:41.683127 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1b70f563-57b9-42bb-8602-8d56d1325f1a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:41.818784 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1b70f563-57b9-42bb-8602-8d56d1325f1a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:41.826914 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1b70f563-57b9-42bb-8602-8d56d1325f1a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1576 microversion: 2.1 time: 0.160816 Jun 26 03:21:41.827483 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 600/1171] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:41 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:42.844887 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4b417915-e5ce-4be1-8ff9-75da652f1c17 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:42.845580 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4b417915-e5ce-4be1-8ff9-75da652f1c17 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:42.852086 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4b417915-e5ce-4be1-8ff9-75da652f1c17 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:42.852541 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4b417915-e5ce-4be1-8ff9-75da652f1c17 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:42.853307 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4b417915-e5ce-4be1-8ff9-75da652f1c17 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:42.854069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4b417915-e5ce-4be1-8ff9-75da652f1c17 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:42.983614 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4b417915-e5ce-4be1-8ff9-75da652f1c17 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:42.991075 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4b417915-e5ce-4be1-8ff9-75da652f1c17 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1576 microversion: 2.1 time: 0.150918 Jun 26 03:21:42.991644 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 572/1172] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:42 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:44.007523 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-2aa345eb-b7a2-4278-8899-f951c27cfc09 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:44.008165 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-2aa345eb-b7a2-4278-8899-f951c27cfc09 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:44.014911 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2aa345eb-b7a2-4278-8899-f951c27cfc09 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:44.015357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2aa345eb-b7a2-4278-8899-f951c27cfc09 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:44.016115 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2aa345eb-b7a2-4278-8899-f951c27cfc09 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:44.016553 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-2aa345eb-b7a2-4278-8899-f951c27cfc09 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:44.102314 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-2aa345eb-b7a2-4278-8899-f951c27cfc09 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:44.110472 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-2aa345eb-b7a2-4278-8899-f951c27cfc09 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1510 microversion: 2.1 time: 0.106626 Jun 26 03:21:44.119631 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 601/1173] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:44 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1510 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:44.386260 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-f05a2671-3fd1-4f75-9424-8d61ab61c40b req-6c3e50db-4b1b-4a54-ab6c-0dbf7e9b9d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1ffc28-1390-49e3-89a2-0e9d284b2321", "name": "network-vif-deleted", "tag": "a55b8d34-2a58-424c-9e6a-07ac0e4655c7"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:21:44.398719 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-f05a2671-3fd1-4f75-9424-8d61ab61c40b req-6c3e50db-4b1b-4a54-ab6c-0dbf7e9b9d49 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:44.399425 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-f05a2671-3fd1-4f75-9424-8d61ab61c40b req-6c3e50db-4b1b-4a54-ab6c-0dbf7e9b9d49 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:44.412067 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-f05a2671-3fd1-4f75-9424-8d61ab61c40b req-6c3e50db-4b1b-4a54-ab6c-0dbf7e9b9d49 service nova] Creating event network-vif-deleted:a55b8d34-2a58-424c-9e6a-07ac0e4655c7 for instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 on hv-cinder-84684 Jun 26 03:21:44.417429 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-f05a2671-3fd1-4f75-9424-8d61ab61c40b req-6c3e50db-4b1b-4a54-ab6c-0dbf7e9b9d49 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035236 Jun 26 03:21:44.418545 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 573/1174] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:21:45.127815 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-6b425a27-87cc-47fc-a1f6-2e5156792fa2 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:45.128531 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-6b425a27-87cc-47fc-a1f6-2e5156792fa2 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:45.136567 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6b425a27-87cc-47fc-a1f6-2e5156792fa2 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:45.137035 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6b425a27-87cc-47fc-a1f6-2e5156792fa2 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:45.137893 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6b425a27-87cc-47fc-a1f6-2e5156792fa2 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:45.138374 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6b425a27-87cc-47fc-a1f6-2e5156792fa2 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:45.176482 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6b425a27-87cc-47fc-a1f6-2e5156792fa2 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:45.176933 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-6b425a27-87cc-47fc-a1f6-2e5156792fa2 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:45.177391 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.objects.instance [None req-6b425a27-87cc-47fc-a1f6-2e5156792fa2 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lazy-loading 'fault' on Instance uuid 8b1ffc28-1390-49e3-89a2-0e9d284b2321 {{(pid=117783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 26 03:21:45.224302 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-6b425a27-87cc-47fc-a1f6-2e5156792fa2 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:45.231841 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-6b425a27-87cc-47fc-a1f6-2e5156792fa2 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 200 len: 1185 microversion: 2.1 time: 0.107392 Jun 26 03:21:45.241623 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 602/1175] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:45 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 1185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:46.250356 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-bce9e317-7fe0-4b86-92b6-a8556ed64cf6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:46.251076 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-bce9e317-7fe0-4b86-92b6-a8556ed64cf6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:46.257246 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bce9e317-7fe0-4b86-92b6-a8556ed64cf6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:46.257692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bce9e317-7fe0-4b86-92b6-a8556ed64cf6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:46.258475 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bce9e317-7fe0-4b86-92b6-a8556ed64cf6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:46.258910 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-bce9e317-7fe0-4b86-92b6-a8556ed64cf6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:46.271909 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-bce9e317-7fe0-4b86-92b6-a8556ed64cf6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] HTTP exception thrown: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-bce9e317-7fe0-4b86-92b6-a8556ed64cf6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Request method failure captured: Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 HTTP/1.1 Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit9AMUUoEE9l4NM5-hXozBivMZZl5AutZYdCaDs_-O45Hf0LHKCI0hoF577yn1cjmKvgQeAi4B-adWFpPMAxnQj23kl5K7Mp7pQY5ZniXM1GONPS9OycL-dNLoqtxs4nXc8DxVcprGFbi7AI-2MTUbShvHIbcx_G5Nxnvbi8-nzlUc2g Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 4a6b41994f444cafb21d3d6e395b6893 Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:21:46.273483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:21:46.275256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a6b41994f444cafb21d3d6e395b6893"}]}] Jun 26 03:21:46.275256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:21:46.275256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 4a6b41994f444cafb21d3d6e395b6893 Jun 26 03:21:46.275256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:21:46.275256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-TestVolumeBootPattern-1214054101-project Jun 26 03:21:46.275256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:21:46.275256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:21:46.275256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 6d52b7f924f24f518ad0c9dfb6008260 Jun 26 03:21:46.275256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-TestVolumeBootPattern-1214054101-project Jun 26 03:21:46.275256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:21:46.275256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:21:46.275256 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '8b1ffc28-1390-49e3-89a2-0e9d284b2321'} Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:21:46.276247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:21:46.277864 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:21:46.279345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-bce9e317-7fe0-4b86-92b6-a8556ed64cf6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Returning 404 to user: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:21:46.279345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-bce9e317-7fe0-4b86-92b6-a8556ed64cf6 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 404 len: 111 microversion: 2.1 time: 0.029536 Jun 26 03:21:46.279345 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 574/1176] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:46 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:21:46.319998 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-307755486", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2006413388", "security_groups": [{"name": "tempest-secgroup-smoke-43239331"}], "block_device_mapping_v2": [{"uuid": "a2747ec3-8990-499c-bf3a-ad67172573dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4925de68-9c6f-4235-8c00-daee335817a4"}]}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:21:46.433051 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] validate_networks() for [('4925de68-9c6f-4235-8c00-daee335817a4', None, None, None, None, None)] {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:21:46.790637 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:21:46.791064 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:21:46.791546 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:21:46.791958 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:21:46.792369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:21:46.801783 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:46.802280 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:46.803077 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:46.803518 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:46.819631 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Getting quotas for project 4a6b41994f444cafb21d3d6e395b6893. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:21:46.823539 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Getting quotas for user 6d52b7f924f24f518ad0c9dfb6008260 and project 4a6b41994f444cafb21d3d6e395b6893. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:21:46.880555 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:21:46.882680 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2747ec3-8990-499c-bf3a-ad67172573dd',volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:21:47.004939 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-bd13d0aa-a488-4e00-ab67-3a0908389a2e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.688675 Jun 26 03:21:47.005571 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 603/1177] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:21:46 2022] POST /compute/v2.1/servers => generated 404 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:21:47.016069 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-0347f2b7-d3a6-4c80-aec9-68ef5eec1f68 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:47.016680 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-0347f2b7-d3a6-4c80-aec9-68ef5eec1f68 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:47.069870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-0347f2b7-d3a6-4c80-aec9-68ef5eec1f68 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:47.077095 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-0347f2b7-d3a6-4c80-aec9-68ef5eec1f68 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1094 microversion: 2.1 time: 0.065359 Jun 26 03:21:47.077661 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 575/1178] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:47 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:48.093634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d4b3ce43-0060-44d2-a730-6f1bfb37895f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:48.094436 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d4b3ce43-0060-44d2-a730-6f1bfb37895f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:48.100516 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d4b3ce43-0060-44d2-a730-6f1bfb37895f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:48.101031 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d4b3ce43-0060-44d2-a730-6f1bfb37895f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:48.101868 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d4b3ce43-0060-44d2-a730-6f1bfb37895f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:48.102333 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d4b3ce43-0060-44d2-a730-6f1bfb37895f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:48.170983 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d4b3ce43-0060-44d2-a730-6f1bfb37895f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:48.178418 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d4b3ce43-0060-44d2-a730-6f1bfb37895f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1210 microversion: 2.1 time: 0.089662 Jun 26 03:21:48.178985 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 604/1179] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:48 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:49.195422 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e660e52a-66f3-4a13-8afa-eff53f11e48c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:49.196667 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e660e52a-66f3-4a13-8afa-eff53f11e48c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:49.204402 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e660e52a-66f3-4a13-8afa-eff53f11e48c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:49.205103 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e660e52a-66f3-4a13-8afa-eff53f11e48c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:49.206148 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e660e52a-66f3-4a13-8afa-eff53f11e48c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:49.206692 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e660e52a-66f3-4a13-8afa-eff53f11e48c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:49.392299 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e660e52a-66f3-4a13-8afa-eff53f11e48c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:49.399648 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e660e52a-66f3-4a13-8afa-eff53f11e48c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1264 microversion: 2.1 time: 0.208553 Jun 26 03:21:49.400467 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 576/1180] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:49 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:49.460847 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-a1b1e426-0615-4447-a1c9-8cf0b95d7d45 req-0bc9d6a8-c8fb-4b56-86da-9fa116cf2748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dade65a2-3652-4abe-b2f1-9c32b95f8c41", "tag": "0899d680-8642-43f4-878d-b695cd950eea"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:21:49.470856 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-a1b1e426-0615-4447-a1c9-8cf0b95d7d45 req-0bc9d6a8-c8fb-4b56-86da-9fa116cf2748 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:49.471578 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-a1b1e426-0615-4447-a1c9-8cf0b95d7d45 req-0bc9d6a8-c8fb-4b56-86da-9fa116cf2748 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:49.484782 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-a1b1e426-0615-4447-a1c9-8cf0b95d7d45 req-0bc9d6a8-c8fb-4b56-86da-9fa116cf2748 service nova] Creating event network-changed:0899d680-8642-43f4-878d-b695cd950eea for instance dade65a2-3652-4abe-b2f1-9c32b95f8c41 on hv-cinder-84684 Jun 26 03:21:49.490013 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-a1b1e426-0615-4447-a1c9-8cf0b95d7d45 req-0bc9d6a8-c8fb-4b56-86da-9fa116cf2748 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033115 Jun 26 03:21:49.490745 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 605/1181] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:21:50.416413 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-3736a7b9-2a97-4caf-8e0c-bfd2e5ccf72a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:50.417060 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-3736a7b9-2a97-4caf-8e0c-bfd2e5ccf72a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:50.423557 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3736a7b9-2a97-4caf-8e0c-bfd2e5ccf72a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:50.424015 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3736a7b9-2a97-4caf-8e0c-bfd2e5ccf72a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:50.424801 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3736a7b9-2a97-4caf-8e0c-bfd2e5ccf72a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:50.425246 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-3736a7b9-2a97-4caf-8e0c-bfd2e5ccf72a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:50.891541 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-3736a7b9-2a97-4caf-8e0c-bfd2e5ccf72a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:50.898973 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-3736a7b9-2a97-4caf-8e0c-bfd2e5ccf72a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1264 microversion: 2.1 time: 0.486422 Jun 26 03:21:50.899534 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 577/1182] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:50 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1264 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:51.916393 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-0fba0ae7-f821-4648-a465-e1d50551c365 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:51.917092 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-0fba0ae7-f821-4648-a465-e1d50551c365 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:51.923310 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0fba0ae7-f821-4648-a465-e1d50551c365 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:51.923765 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0fba0ae7-f821-4648-a465-e1d50551c365 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:51.924529 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0fba0ae7-f821-4648-a465-e1d50551c365 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:51.924973 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-0fba0ae7-f821-4648-a465-e1d50551c365 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:52.052001 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-0fba0ae7-f821-4648-a465-e1d50551c365 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:52.060369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-0fba0ae7-f821-4648-a465-e1d50551c365 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1264 microversion: 2.1 time: 0.148603 Jun 26 03:21:52.060948 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 606/1183] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:51 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:53.077534 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f0718b48-73e7-49b3-8ab4-2b9eeeb02659 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:53.078166 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f0718b48-73e7-49b3-8ab4-2b9eeeb02659 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:53.085050 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f0718b48-73e7-49b3-8ab4-2b9eeeb02659 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:53.085496 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f0718b48-73e7-49b3-8ab4-2b9eeeb02659 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:53.086279 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f0718b48-73e7-49b3-8ab4-2b9eeeb02659 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:53.086712 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f0718b48-73e7-49b3-8ab4-2b9eeeb02659 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:53.219615 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f0718b48-73e7-49b3-8ab4-2b9eeeb02659 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:53.226928 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f0718b48-73e7-49b3-8ab4-2b9eeeb02659 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1264 microversion: 2.1 time: 0.154045 Jun 26 03:21:53.227488 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 578/1184] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:53 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:54.243499 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-8eec6516-463c-48e8-a57d-356e6311d673 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:54.244118 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-8eec6516-463c-48e8-a57d-356e6311d673 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:54.251024 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8eec6516-463c-48e8-a57d-356e6311d673 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:54.251480 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8eec6516-463c-48e8-a57d-356e6311d673 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:54.252249 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8eec6516-463c-48e8-a57d-356e6311d673 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:54.252692 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-8eec6516-463c-48e8-a57d-356e6311d673 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:54.383271 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-8eec6516-463c-48e8-a57d-356e6311d673 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:54.391403 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-8eec6516-463c-48e8-a57d-356e6311d673 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1264 microversion: 2.1 time: 0.151856 Jun 26 03:21:54.391959 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 607/1185] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:54 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:55.407809 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-816d876b-85e1-4a1c-a584-530319d1091f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:55.408403 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-816d876b-85e1-4a1c-a584-530319d1091f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:55.414862 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-816d876b-85e1-4a1c-a584-530319d1091f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:55.415312 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-816d876b-85e1-4a1c-a584-530319d1091f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:55.416073 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-816d876b-85e1-4a1c-a584-530319d1091f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:55.416508 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-816d876b-85e1-4a1c-a584-530319d1091f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:55.549448 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-816d876b-85e1-4a1c-a584-530319d1091f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:55.556839 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-816d876b-85e1-4a1c-a584-530319d1091f tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1264 microversion: 2.1 time: 0.152886 Jun 26 03:21:55.557411 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 579/1186] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:55 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:56.573419 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-ea1b5797-a319-4d23-966a-2df754c87c66 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:56.573939 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-ea1b5797-a319-4d23-966a-2df754c87c66 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:56.580343 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ea1b5797-a319-4d23-966a-2df754c87c66 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:56.580794 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ea1b5797-a319-4d23-966a-2df754c87c66 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:56.581547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ea1b5797-a319-4d23-966a-2df754c87c66 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:56.581983 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-ea1b5797-a319-4d23-966a-2df754c87c66 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:56.715011 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-ea1b5797-a319-4d23-966a-2df754c87c66 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:56.722530 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-ea1b5797-a319-4d23-966a-2df754c87c66 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1264 microversion: 2.1 time: 0.152992 Jun 26 03:21:56.723090 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 608/1187] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:56 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:21:57.739853 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-b9cb103c-1eb9-4d09-ae91-4b05732b35d1 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:57.740394 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-b9cb103c-1eb9-4d09-ae91-4b05732b35d1 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:57.742763 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=2 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:57.749580 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b9cb103c-1eb9-4d09-ae91-4b05732b35d1 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:57.750027 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b9cb103c-1eb9-4d09-ae91-4b05732b35d1 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:57.750803 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b9cb103c-1eb9-4d09-ae91-4b05732b35d1 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:57.751234 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-b9cb103c-1eb9-4d09-ae91-4b05732b35d1 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:57.882456 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-b9cb103c-1eb9-4d09-ae91-4b05732b35d1 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:57.890854 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-b9cb103c-1eb9-4d09-ae91-4b05732b35d1 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1264 microversion: 2.1 time: 0.155224 Jun 26 03:21:57.891415 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 580/1188] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:57 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:21:58.908235 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-10068f18-a8cb-4db8-bc6d-5f2b8ea4b39d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:21:58.908877 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-10068f18-a8cb-4db8-bc6d-5f2b8ea4b39d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:21:58.910837 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=2 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:58.911487 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=6 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:58.917989 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-10068f18-a8cb-4db8-bc6d-5f2b8ea4b39d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:58.918468 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-10068f18-a8cb-4db8-bc6d-5f2b8ea4b39d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:58.919227 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-10068f18-a8cb-4db8-bc6d-5f2b8ea4b39d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:21:58.919664 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-10068f18-a8cb-4db8-bc6d-5f2b8ea4b39d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:21:59.045508 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-10068f18-a8cb-4db8-bc6d-5f2b8ea4b39d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:21:59.053039 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-10068f18-a8cb-4db8-bc6d-5f2b8ea4b39d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1264 microversion: 2.1 time: 0.148733 Jun 26 03:21:59.053607 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 609/1189] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:21:58 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:22:00.059369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-d262c1cf-b44c-4a78-b5fc-6830b6bfd2a1 req-92bdbb8a-681c-456e-b433-1759119fb3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dade65a2-3652-4abe-b2f1-9c32b95f8c41", "name": "network-vif-plugged", "status": "completed", "tag": "0899d680-8642-43f4-878d-b695cd950eea"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:22:00.068534 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-d262c1cf-b44c-4a78-b5fc-6830b6bfd2a1 req-92bdbb8a-681c-456e-b433-1759119fb3c4 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:00.068969 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-d262c1cf-b44c-4a78-b5fc-6830b6bfd2a1 req-92bdbb8a-681c-456e-b433-1759119fb3c4 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:00.070791 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b291c79f-6e97-4cdf-9905-7716d3402228 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:22:00.071982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b291c79f-6e97-4cdf-9905-7716d3402228 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:22:00.079188 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b291c79f-6e97-4cdf-9905-7716d3402228 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:00.079642 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b291c79f-6e97-4cdf-9905-7716d3402228 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:00.080414 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b291c79f-6e97-4cdf-9905-7716d3402228 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:00.080918 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b291c79f-6e97-4cdf-9905-7716d3402228 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:00.083813 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-d262c1cf-b44c-4a78-b5fc-6830b6bfd2a1 req-92bdbb8a-681c-456e-b433-1759119fb3c4 service nova] Creating event network-vif-plugged:0899d680-8642-43f4-878d-b695cd950eea for instance dade65a2-3652-4abe-b2f1-9c32b95f8c41 on hv-cinder-84684 Jun 26 03:22:00.089068 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-d262c1cf-b44c-4a78-b5fc-6830b6bfd2a1 req-92bdbb8a-681c-456e-b433-1759119fb3c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033812 Jun 26 03:22:00.089661 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 581/1190] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:22:00.216572 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-b291c79f-6e97-4cdf-9905-7716d3402228 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:22:00.224213 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b291c79f-6e97-4cdf-9905-7716d3402228 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1264 microversion: 2.1 time: 0.158751 Jun 26 03:22:00.224794 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 610/1191] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:22:00 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:22:01.241163 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-e0aabbc4-81a8-46ec-9f15-93e0bf9f5827 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:22:01.241855 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-e0aabbc4-81a8-46ec-9f15-93e0bf9f5827 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:22:01.249111 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e0aabbc4-81a8-46ec-9f15-93e0bf9f5827 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:01.249554 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e0aabbc4-81a8-46ec-9f15-93e0bf9f5827 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:01.250359 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e0aabbc4-81a8-46ec-9f15-93e0bf9f5827 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:01.250798 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-e0aabbc4-81a8-46ec-9f15-93e0bf9f5827 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:01.378933 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-e0aabbc4-81a8-46ec-9f15-93e0bf9f5827 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:22:01.386581 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-e0aabbc4-81a8-46ec-9f15-93e0bf9f5827 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1264 microversion: 2.1 time: 0.149667 Jun 26 03:22:01.387152 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 582/1192] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:22:01 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:22:02.403017 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-f9f7efcb-dfe8-43b4-9916-6dae8c1ab12c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:22:02.403617 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-f9f7efcb-dfe8-43b4-9916-6dae8c1ab12c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:22:02.410081 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9f7efcb-dfe8-43b4-9916-6dae8c1ab12c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:02.410536 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9f7efcb-dfe8-43b4-9916-6dae8c1ab12c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:02.411342 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9f7efcb-dfe8-43b4-9916-6dae8c1ab12c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:02.411779 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-f9f7efcb-dfe8-43b4-9916-6dae8c1ab12c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:02.541949 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-f9f7efcb-dfe8-43b4-9916-6dae8c1ab12c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:22:02.549958 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-f9f7efcb-dfe8-43b4-9916-6dae8c1ab12c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1450 microversion: 2.1 time: 0.150788 Jun 26 03:22:02.550547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 611/1193] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:22:02 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:22:02.566175 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c2e00851-e425-4b21-b331-fcc1dc672481 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:22:02.566782 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c2e00851-e425-4b21-b331-fcc1dc672481 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:22:02.573136 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c2e00851-e425-4b21-b331-fcc1dc672481 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:02.573582 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c2e00851-e425-4b21-b331-fcc1dc672481 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:02.574363 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c2e00851-e425-4b21-b331-fcc1dc672481 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:02.574795 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c2e00851-e425-4b21-b331-fcc1dc672481 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:02.701835 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-c2e00851-e425-4b21-b331-fcc1dc672481 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:22:02.709213 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c2e00851-e425-4b21-b331-fcc1dc672481 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1450 microversion: 2.1 time: 0.146935 Jun 26 03:22:02.709763 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 583/1194] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:22:02 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:22:04.252652 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-bb3ddd2e-81a2-45ca-8212-61adaa0f375c req-720650d2-5b97-47d7-be8e-1ff79ded4afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dade65a2-3652-4abe-b2f1-9c32b95f8c41", "tag": "0899d680-8642-43f4-878d-b695cd950eea"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:22:04.261948 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-bb3ddd2e-81a2-45ca-8212-61adaa0f375c req-720650d2-5b97-47d7-be8e-1ff79ded4afe service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:04.262515 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-bb3ddd2e-81a2-45ca-8212-61adaa0f375c req-720650d2-5b97-47d7-be8e-1ff79ded4afe service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:04.273239 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-bb3ddd2e-81a2-45ca-8212-61adaa0f375c req-720650d2-5b97-47d7-be8e-1ff79ded4afe service nova] Creating event network-changed:0899d680-8642-43f4-878d-b695cd950eea for instance dade65a2-3652-4abe-b2f1-9c32b95f8c41 on hv-cinder-84684 Jun 26 03:22:04.278503 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-bb3ddd2e-81a2-45ca-8212-61adaa0f375c req-720650d2-5b97-47d7-be8e-1ff79ded4afe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029518 Jun 26 03:22:04.279152 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 612/1195] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:22:43.660820 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-26759985-f7ce-4734-9405-5c3a2cba5adc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:22:43.661360 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-26759985-f7ce-4734-9405-5c3a2cba5adc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:22:43.664840 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:22:43.666102 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=68 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:22:43.668247 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:22:43.669144 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:22:43.671151 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-fd315269-a9a9-4df8-979e-ef218a5a39cd req-e4a50b6a-9a32-482d-9661-5a9c2be0360f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad8a4d7-e228-4988-a099-a49eba183537", "tag": "8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:22:43.674466 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-26759985-f7ce-4734-9405-5c3a2cba5adc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:43.674927 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-26759985-f7ce-4734-9405-5c3a2cba5adc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:43.675851 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-26759985-f7ce-4734-9405-5c3a2cba5adc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:43.676305 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-26759985-f7ce-4734-9405-5c3a2cba5adc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:43.680268 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-fd315269-a9a9-4df8-979e-ef218a5a39cd req-e4a50b6a-9a32-482d-9661-5a9c2be0360f service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:43.680718 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-fd315269-a9a9-4df8-979e-ef218a5a39cd req-e4a50b6a-9a32-482d-9661-5a9c2be0360f service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:43.692694 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-fd315269-a9a9-4df8-979e-ef218a5a39cd req-e4a50b6a-9a32-482d-9661-5a9c2be0360f service nova] Creating event network-changed:8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf for instance dad8a4d7-e228-4988-a099-a49eba183537 on hv-cinder-84684 Jun 26 03:22:43.697957 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-fd315269-a9a9-4df8-979e-ef218a5a39cd req-e4a50b6a-9a32-482d-9661-5a9c2be0360f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034488 Jun 26 03:22:43.699379 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 613/1196] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:22:43.708866 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-26759985-f7ce-4734-9405-5c3a2cba5adc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Going to try to terminate instance {{(pid=117782) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:22:43.811357 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-26759985-f7ce-4734-9405-5c3a2cba5adc tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 204 len: 0 microversion: 2.1 time: 0.153741 Jun 26 03:22:43.812214 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 584/1197] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:22:43 2022] DELETE /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:22:43.820995 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-1bf37f15-c5fb-4494-8f76-20c37a971d1e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:22:43.821691 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-1bf37f15-c5fb-4494-8f76-20c37a971d1e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:22:43.827992 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1bf37f15-c5fb-4494-8f76-20c37a971d1e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:43.828446 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1bf37f15-c5fb-4494-8f76-20c37a971d1e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:43.829223 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1bf37f15-c5fb-4494-8f76-20c37a971d1e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:43.829657 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-1bf37f15-c5fb-4494-8f76-20c37a971d1e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:43.985965 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-1bf37f15-c5fb-4494-8f76-20c37a971d1e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:22:43.993531 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-1bf37f15-c5fb-4494-8f76-20c37a971d1e tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1568 microversion: 2.1 time: 0.176839 Jun 26 03:22:43.994191 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 614/1198] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:22:43 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:22:45.012299 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1d30eb13-a14d-41c0-81bf-c336e7f863d2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:22:45.012994 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1d30eb13-a14d-41c0-81bf-c336e7f863d2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:22:45.019067 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1d30eb13-a14d-41c0-81bf-c336e7f863d2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:45.019514 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1d30eb13-a14d-41c0-81bf-c336e7f863d2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:45.020298 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1d30eb13-a14d-41c0-81bf-c336e7f863d2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:45.020735 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1d30eb13-a14d-41c0-81bf-c336e7f863d2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:45.187870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1d30eb13-a14d-41c0-81bf-c336e7f863d2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:22:45.195326 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1d30eb13-a14d-41c0-81bf-c336e7f863d2 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1568 microversion: 2.1 time: 0.187724 Jun 26 03:22:45.195886 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 585/1199] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:22:45 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:22:46.027055 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-19325bcd-deb6-49db-8b5f-a59eeca3984a req-f572af89-238d-43fe-b1b9-dc9532e13e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad8a4d7-e228-4988-a099-a49eba183537", "name": "network-vif-deleted", "tag": "8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:22:46.035763 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-19325bcd-deb6-49db-8b5f-a59eeca3984a req-f572af89-238d-43fe-b1b9-dc9532e13e87 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:46.036218 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-19325bcd-deb6-49db-8b5f-a59eeca3984a req-f572af89-238d-43fe-b1b9-dc9532e13e87 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:46.049725 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-19325bcd-deb6-49db-8b5f-a59eeca3984a req-f572af89-238d-43fe-b1b9-dc9532e13e87 service nova] Creating event network-vif-deleted:8fb8465e-f5a6-4cd4-ae39-7cbb3d5e4eaf for instance dad8a4d7-e228-4988-a099-a49eba183537 on hv-cinder-84684 Jun 26 03:22:46.055724 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-19325bcd-deb6-49db-8b5f-a59eeca3984a req-f572af89-238d-43fe-b1b9-dc9532e13e87 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032223 Jun 26 03:22:46.056316 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 615/1200] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:22:46.212583 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-f59cbdcf-6e4d-4cb6-8148-81f481c8d4c9 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:22:46.213132 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-f59cbdcf-6e4d-4cb6-8148-81f481c8d4c9 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:22:46.219516 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f59cbdcf-6e4d-4cb6-8148-81f481c8d4c9 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:46.219972 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f59cbdcf-6e4d-4cb6-8148-81f481c8d4c9 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:46.220730 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f59cbdcf-6e4d-4cb6-8148-81f481c8d4c9 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:46.221168 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-f59cbdcf-6e4d-4cb6-8148-81f481c8d4c9 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:46.284313 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-f59cbdcf-6e4d-4cb6-8148-81f481c8d4c9 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa6dfc6e5c14046b499354e0f07a404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a33a31ba6046e78352f5ba9e88b9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:22:46.292175 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-f59cbdcf-6e4d-4cb6-8148-81f481c8d4c9 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 200 len: 1219 microversion: 2.1 time: 0.083507 Jun 26 03:22:46.292753 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 586/1201] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:22:46 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:22:47.310824 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d952142b-2cb2-4e2c-90e1-d67e41d05794 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:22:47.311513 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d952142b-2cb2-4e2c-90e1-d67e41d05794 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] [instance: dad8a4d7-e228-4988-a099-a49eba183537] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:22:47.317623 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d952142b-2cb2-4e2c-90e1-d67e41d05794 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:47.318101 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d952142b-2cb2-4e2c-90e1-d67e41d05794 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:47.318855 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d952142b-2cb2-4e2c-90e1-d67e41d05794 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:22:47.319296 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d952142b-2cb2-4e2c-90e1-d67e41d05794 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:22:47.333458 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-d952142b-2cb2-4e2c-90e1-d67e41d05794 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] HTTP exception thrown: Instance dad8a4d7-e228-4988-a099-a49eba183537 could not be found. Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d952142b-2cb2-4e2c-90e1-d67e41d05794 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Request method failure captured: Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 HTTP/1.1 Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit8_QlheYN20F-xnrubjWh6B_9U3ubm1BFaGjVGzG0rTaFya4B-D2cPnbvPtKRsnHil0_8O9zp_HPHv0uPFlqLXvTkNZZBMmjy9pqtLQ3maRU1ad_AnGsKbZeYG8oUCd9kXh0IOt12hdE1_C3Ghbgp507R8IivCkaeuKpZYAw4C9beyk Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 80a33a31ba6046e78352f5ba9e88b9fe Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-TestShelveInstance-508384766 Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:22:47.335569 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:22:47.337443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_80a33a31ba6046e78352f5ba9e88b9fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/80a33a31ba6046e78352f5ba9e88b9fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/80a33a31ba6046e78352f5ba9e88b9fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/80a33a31ba6046e78352f5ba9e88b9fe"}]}] Jun 26 03:22:47.337443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-TestShelveInstance-508384766 Jun 26 03:22:47.337443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 80a33a31ba6046e78352f5ba9e88b9fe Jun 26 03:22:47.337443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-TestShelveInstance-508384766 Jun 26 03:22:47.337443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-TestShelveInstance-508384766-project Jun 26 03:22:47.337443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:22:47.337443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:22:47.337443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: faa6dfc6e5c14046b499354e0f07a404 Jun 26 03:22:47.337443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-TestShelveInstance-508384766-project Jun 26 03:22:47.337443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:22:47.337443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance dad8a4d7-e228-4988-a099-a49eba183537 could not be found. Jun 26 03:22:47.337443 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': 'dad8a4d7-e228-4988-a099-a49eba183537'} Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dad8a4d7-e228-4988-a099-a49eba183537 could not be found. Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:22:47.338559 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dad8a4d7-e228-4988-a099-a49eba183537 could not be found. Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dad8a4d7-e228-4988-a099-a49eba183537 could not be found. Jun 26 03:22:47.340210 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:22:47.341686 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d952142b-2cb2-4e2c-90e1-d67e41d05794 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Returning 404 to user: Instance dad8a4d7-e228-4988-a099-a49eba183537 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:22:47.341686 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d952142b-2cb2-4e2c-90e1-d67e41d05794 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537" status: 404 len: 111 microversion: 2.1 time: 0.031424 Jun 26 03:22:47.341686 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 616/1202] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:22:47 2022] GET /compute/v2.1/servers/dad8a4d7-e228-4988-a099-a49eba183537 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:22:47.497137 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-5d67e9d3-a97f-4354-b53c-6dfb7dec0758 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] Calling method '.version_select at 0x7f582c213b80>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:22:47.524278 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-5d67e9d3-a97f-4354-b53c-6dfb7dec0758 tempest-TestShelveInstance-508384766 tempest-TestShelveInstance-508384766-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2005754739" status: 202 len: 0 microversion: 2.1 time: 0.031686 Jun 26 03:22:47.525118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 587/1203] 10.222.0.13 () {58 vars in 1253 bytes} [Sun Jun 26 03:22:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2005754739 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 26 03:23:14.377357 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:23:14.377983 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Sun Jun 26 03:23:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:24:03.120763 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ab4b7b4-1408-4ff3-8571-99c76aa0b1d2] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 26 03:24:03.121306 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=8 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:24:03.122157 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=12 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:24:03.126144 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-666397684", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2006413388", "security_groups": [{"name": "tempest-secgroup-smoke-43239331"}], "block_device_mapping_v2": [{"uuid": "95807af5-2e0d-428f-8141-49d268e11312", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4925de68-9c6f-4235-8c00-daee335817a4"}]}} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:24:03.239751 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.network.neutron [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] validate_networks() for [('4925de68-9c6f-4235-8c00-daee335817a4', None, None, None, None, None)] {{(pid=117783) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 26 03:24:03.600190 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Flavor limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 26 03:24:03.600610 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Image limits 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 26 03:24:03.601079 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Flavor pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 26 03:24:03.601481 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Image pref 0:0:0 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 26 03:24:03.601897 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.virt.hardware [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 26 03:24:03.610552 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:03.610934 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:03.611722 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:03.612154 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:03.628690 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Getting quotas for project 4a6b41994f444cafb21d3d6e395b6893. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 26 03:24:03.632565 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.quota [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Getting quotas for user 6d52b7f924f24f518ad0c9dfb6008260 and project 4a6b41994f444cafb21d3d6e395b6893. Resources: {'ram', 'cores', 'instances'} {{(pid=117783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 26 03:24:03.687442 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Going to run 1 instances... {{(pid=117783) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 26 03:24:03.689488 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='95807af5-2e0d-428f-8141-49d268e11312',volume_size=None,volume_type=None)] {{(pid=117783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 26 03:24:03.813039 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-35742f0c-9183-481e-b61f-45de5155c65c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.694189 Jun 26 03:24:03.813676 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 617/1204] 10.222.0.13 () {60 vars in 1146 bytes} [Sun Jun 26 03:24:03 2022] POST /compute/v2.1/servers => generated 404 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 26 03:24:03.821822 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:24:03.822594 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:24:03.826718 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-63cf1edb-50e2-4361-8698-624dc7b2a5c0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:03.827331 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-63cf1edb-50e2-4361-8698-624dc7b2a5c0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:03.886381 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-63cf1edb-50e2-4361-8698-624dc7b2a5c0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:03.893718 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-63cf1edb-50e2-4361-8698-624dc7b2a5c0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1094 microversion: 2.1 time: 0.073899 Jun 26 03:24:03.894870 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 588/1205] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:03 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:04.913060 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-128ab832-c4cc-469f-aeb3-64ce9e476d80 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:04.913661 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-128ab832-c4cc-469f-aeb3-64ce9e476d80 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:04.923044 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-128ab832-c4cc-469f-aeb3-64ce9e476d80 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:04.923506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-128ab832-c4cc-469f-aeb3-64ce9e476d80 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:04.924277 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-128ab832-c4cc-469f-aeb3-64ce9e476d80 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:04.924714 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-128ab832-c4cc-469f-aeb3-64ce9e476d80 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:04.929174 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ab4b7b4-1408-4ff3-8571-99c76aa0b1d2] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 32884. Jun 26 03:24:05.007906 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-128ab832-c4cc-469f-aeb3-64ce9e476d80 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:05.015720 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-128ab832-c4cc-469f-aeb3-64ce9e476d80 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1210 microversion: 2.1 time: 0.108623 Jun 26 03:24:05.016604 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 618/1206] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:04 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:06.032961 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a65ff7c6-df4c-4a2f-ada1-c70dcaaca9cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:06.034275 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a65ff7c6-df4c-4a2f-ada1-c70dcaaca9cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:06.041097 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a65ff7c6-df4c-4a2f-ada1-c70dcaaca9cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:06.041802 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a65ff7c6-df4c-4a2f-ada1-c70dcaaca9cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:06.042832 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a65ff7c6-df4c-4a2f-ada1-c70dcaaca9cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:06.043660 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a65ff7c6-df4c-4a2f-ada1-c70dcaaca9cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:06.252175 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a65ff7c6-df4c-4a2f-ada1-c70dcaaca9cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:06.260514 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a65ff7c6-df4c-4a2f-ada1-c70dcaaca9cd tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1264 microversion: 2.1 time: 0.231395 Jun 26 03:24:06.261410 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 589/1207] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:06 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:06.442719 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-2ae8da73-5bfc-4bf8-9325-0fae78dc6adf req-26e84c02-c5cf-4c3d-9a8e-62996ff6ac2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2939ac2-cfe5-449c-9134-331f6d917b68", "tag": "4e3a7e52-0222-4385-a9cc-7284b4ff51b7"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:24:06.451459 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-2ae8da73-5bfc-4bf8-9325-0fae78dc6adf req-26e84c02-c5cf-4c3d-9a8e-62996ff6ac2d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:06.451917 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-2ae8da73-5bfc-4bf8-9325-0fae78dc6adf req-26e84c02-c5cf-4c3d-9a8e-62996ff6ac2d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:06.463810 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-2ae8da73-5bfc-4bf8-9325-0fae78dc6adf req-26e84c02-c5cf-4c3d-9a8e-62996ff6ac2d service nova] Creating event network-changed:4e3a7e52-0222-4385-a9cc-7284b4ff51b7 for instance f2939ac2-cfe5-449c-9134-331f6d917b68 on hv-cinder-84684 Jun 26 03:24:06.468932 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-2ae8da73-5bfc-4bf8-9325-0fae78dc6adf req-26e84c02-c5cf-4c3d-9a8e-62996ff6ac2d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182117 Jun 26 03:24:06.469770 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 619/1208] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:24:07.277959 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-4b9b7e09-b056-47cd-8dc1-a44d9347df87 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:07.278601 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-4b9b7e09-b056-47cd-8dc1-a44d9347df87 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:07.285037 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4b9b7e09-b056-47cd-8dc1-a44d9347df87 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:07.285490 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4b9b7e09-b056-47cd-8dc1-a44d9347df87 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:07.286304 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4b9b7e09-b056-47cd-8dc1-a44d9347df87 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:07.286754 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-4b9b7e09-b056-47cd-8dc1-a44d9347df87 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:07.413715 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-4b9b7e09-b056-47cd-8dc1-a44d9347df87 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:07.421118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-4b9b7e09-b056-47cd-8dc1-a44d9347df87 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1264 microversion: 2.1 time: 0.147031 Jun 26 03:24:07.421670 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 590/1209] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:07 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:08.438603 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-3f6e7e08-38f8-44fa-9b04-b21370f19e73 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:08.439333 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-3f6e7e08-38f8-44fa-9b04-b21370f19e73 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:08.445484 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3f6e7e08-38f8-44fa-9b04-b21370f19e73 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:08.445934 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3f6e7e08-38f8-44fa-9b04-b21370f19e73 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:08.446717 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3f6e7e08-38f8-44fa-9b04-b21370f19e73 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:08.447152 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-3f6e7e08-38f8-44fa-9b04-b21370f19e73 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:08.823215 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-3f6e7e08-38f8-44fa-9b04-b21370f19e73 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:08.830496 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-3f6e7e08-38f8-44fa-9b04-b21370f19e73 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1264 microversion: 2.1 time: 0.396495 Jun 26 03:24:08.831054 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 620/1210] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:08 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1264 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:09.848313 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-070381ea-3f89-4f2a-a889-d6b72e4b863e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:09.848906 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-070381ea-3f89-4f2a-a889-d6b72e4b863e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:09.855443 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-070381ea-3f89-4f2a-a889-d6b72e4b863e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:09.855890 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-070381ea-3f89-4f2a-a889-d6b72e4b863e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:09.856646 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-070381ea-3f89-4f2a-a889-d6b72e4b863e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:09.857079 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-070381ea-3f89-4f2a-a889-d6b72e4b863e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:09.984306 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-070381ea-3f89-4f2a-a889-d6b72e4b863e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:09.991594 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-070381ea-3f89-4f2a-a889-d6b72e4b863e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1264 microversion: 2.1 time: 0.147800 Jun 26 03:24:09.992149 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 591/1211] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:09 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:11.008634 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-02ee4290-93b4-4cc2-8e70-ea3de671192a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:11.009444 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-02ee4290-93b4-4cc2-8e70-ea3de671192a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:11.016178 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-02ee4290-93b4-4cc2-8e70-ea3de671192a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:11.016628 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-02ee4290-93b4-4cc2-8e70-ea3de671192a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:11.017395 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-02ee4290-93b4-4cc2-8e70-ea3de671192a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:11.017833 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-02ee4290-93b4-4cc2-8e70-ea3de671192a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:11.146916 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-02ee4290-93b4-4cc2-8e70-ea3de671192a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:11.154674 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-02ee4290-93b4-4cc2-8e70-ea3de671192a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1264 microversion: 2.1 time: 0.149822 Jun 26 03:24:11.155281 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 621/1212] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:11 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:12.172321 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-638e70e6-f074-4cf8-a8f7-8d0210b74a38 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:12.172907 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-638e70e6-f074-4cf8-a8f7-8d0210b74a38 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:12.180337 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-638e70e6-f074-4cf8-a8f7-8d0210b74a38 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:12.180783 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-638e70e6-f074-4cf8-a8f7-8d0210b74a38 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:12.181549 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-638e70e6-f074-4cf8-a8f7-8d0210b74a38 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:12.181983 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-638e70e6-f074-4cf8-a8f7-8d0210b74a38 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:12.315346 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-638e70e6-f074-4cf8-a8f7-8d0210b74a38 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:12.323775 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-638e70e6-f074-4cf8-a8f7-8d0210b74a38 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1264 microversion: 2.1 time: 0.155296 Jun 26 03:24:12.324347 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 592/1213] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:12 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:13.339872 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-63283d35-b209-43b6-893d-b8f71bb8f22a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:13.340543 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-63283d35-b209-43b6-893d-b8f71bb8f22a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:13.346671 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-63283d35-b209-43b6-893d-b8f71bb8f22a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:13.347118 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-63283d35-b209-43b6-893d-b8f71bb8f22a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:13.347926 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-63283d35-b209-43b6-893d-b8f71bb8f22a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:13.348361 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-63283d35-b209-43b6-893d-b8f71bb8f22a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:13.477521 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-63283d35-b209-43b6-893d-b8f71bb8f22a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:13.484877 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-63283d35-b209-43b6-893d-b8f71bb8f22a tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1264 microversion: 2.1 time: 0.148844 Jun 26 03:24:13.485440 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 622/1214] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:13 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:14.500523 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-a62c4a80-d3fa-416e-9966-f46d7c421558 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:14.501132 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-a62c4a80-d3fa-416e-9966-f46d7c421558 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:14.503175 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell0:SELECT=2 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:24:14.508750 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a62c4a80-d3fa-416e-9966-f46d7c421558 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:14.509231 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a62c4a80-d3fa-416e-9966-f46d7c421558 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:14.510006 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a62c4a80-d3fa-416e-9966-f46d7c421558 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:14.510483 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-a62c4a80-d3fa-416e-9966-f46d7c421558 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:14.642151 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-a62c4a80-d3fa-416e-9966-f46d7c421558 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:14.650080 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-a62c4a80-d3fa-416e-9966-f46d7c421558 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1264 microversion: 2.1 time: 0.153339 Jun 26 03:24:14.650656 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 593/1215] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:14 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:15.666838 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-d0f6db9b-7123-4652-b5b5-12127e817658 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:15.667469 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-d0f6db9b-7123-4652-b5b5-12127e817658 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:15.669362 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=2 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:24:15.670132 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell0:SELECT=6 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:24:15.676982 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d0f6db9b-7123-4652-b5b5-12127e817658 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:15.677433 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d0f6db9b-7123-4652-b5b5-12127e817658 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:15.678228 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d0f6db9b-7123-4652-b5b5-12127e817658 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:15.678662 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-d0f6db9b-7123-4652-b5b5-12127e817658 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:15.804154 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-d0f6db9b-7123-4652-b5b5-12127e817658 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:15.811449 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-d0f6db9b-7123-4652-b5b5-12127e817658 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1264 microversion: 2.1 time: 0.148450 Jun 26 03:24:15.812029 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 623/1216] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:15 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:16.787329 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [req-ee326409-cd7c-4ac6-b3d2-89f056cfc17e req-47dff04d-5f3f-4ee2-b113-354cc4000a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2939ac2-cfe5-449c-9134-331f6d917b68", "name": "network-vif-plugged", "status": "completed", "tag": "4e3a7e52-0222-4385-a9cc-7284b4ff51b7"}]} {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:24:16.797317 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-ee326409-cd7c-4ac6-b3d2-89f056cfc17e req-47dff04d-5f3f-4ee2-b113-354cc4000a6f service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:16.797941 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [req-ee326409-cd7c-4ac6-b3d2-89f056cfc17e req-47dff04d-5f3f-4ee2-b113-354cc4000a6f service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:16.811234 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.compute.server_external_events [req-ee326409-cd7c-4ac6-b3d2-89f056cfc17e req-47dff04d-5f3f-4ee2-b113-354cc4000a6f service nova] Creating event network-vif-plugged:4e3a7e52-0222-4385-a9cc-7284b4ff51b7 for instance f2939ac2-cfe5-449c-9134-331f6d917b68 on hv-cinder-84684 Jun 26 03:24:16.817009 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [req-ee326409-cd7c-4ac6-b3d2-89f056cfc17e req-47dff04d-5f3f-4ee2-b113-354cc4000a6f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093044 Jun 26 03:24:16.817579 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 594/1217] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:24:16.827553 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-78a0e397-2968-4c3a-972b-6450ee66b878 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:16.828165 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-78a0e397-2968-4c3a-972b-6450ee66b878 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:16.834886 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-78a0e397-2968-4c3a-972b-6450ee66b878 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:16.835334 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-78a0e397-2968-4c3a-972b-6450ee66b878 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:16.836083 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-78a0e397-2968-4c3a-972b-6450ee66b878 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:16.836516 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-78a0e397-2968-4c3a-972b-6450ee66b878 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:16.974332 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-78a0e397-2968-4c3a-972b-6450ee66b878 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:16.981817 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-78a0e397-2968-4c3a-972b-6450ee66b878 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1264 microversion: 2.1 time: 0.158046 Jun 26 03:24:16.982406 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 624/1218] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:16 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:18.000299 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1024fbe5-1986-4afc-8638-3fd6c56c4161 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:18.000995 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1024fbe5-1986-4afc-8638-3fd6c56c4161 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:18.008151 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1024fbe5-1986-4afc-8638-3fd6c56c4161 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:18.008602 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1024fbe5-1986-4afc-8638-3fd6c56c4161 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:18.009364 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1024fbe5-1986-4afc-8638-3fd6c56c4161 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:18.009803 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1024fbe5-1986-4afc-8638-3fd6c56c4161 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:18.140302 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-1024fbe5-1986-4afc-8638-3fd6c56c4161 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:18.147817 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1024fbe5-1986-4afc-8638-3fd6c56c4161 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1264 microversion: 2.1 time: 0.151664 Jun 26 03:24:18.148385 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 595/1219] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:17 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:19.164354 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-90fef4c8-36ab-40fe-a29c-5887439b7fe3 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:19.164962 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-90fef4c8-36ab-40fe-a29c-5887439b7fe3 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:19.171350 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-90fef4c8-36ab-40fe-a29c-5887439b7fe3 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:19.171810 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-90fef4c8-36ab-40fe-a29c-5887439b7fe3 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:19.172577 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-90fef4c8-36ab-40fe-a29c-5887439b7fe3 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:19.173019 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-90fef4c8-36ab-40fe-a29c-5887439b7fe3 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:19.299721 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-90fef4c8-36ab-40fe-a29c-5887439b7fe3 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:19.307203 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-90fef4c8-36ab-40fe-a29c-5887439b7fe3 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1450 microversion: 2.1 time: 0.147390 Jun 26 03:24:19.307765 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 625/1220] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:19 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:19.323781 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8f75a972-0678-4979-8b60-7012a03d9e5d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:24:19.324395 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8f75a972-0678-4979-8b60-7012a03d9e5d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:24:19.330891 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8f75a972-0678-4979-8b60-7012a03d9e5d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:19.331344 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8f75a972-0678-4979-8b60-7012a03d9e5d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:19.332703 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8f75a972-0678-4979-8b60-7012a03d9e5d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:19.333142 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8f75a972-0678-4979-8b60-7012a03d9e5d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:19.457546 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8f75a972-0678-4979-8b60-7012a03d9e5d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:24:19.465045 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8f75a972-0678-4979-8b60-7012a03d9e5d tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1450 microversion: 2.1 time: 0.145069 Jun 26 03:24:19.465609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 596/1221] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:24:19 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:24:20.999824 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-fb7c7480-43f9-438f-a0a7-2ccba2f0618d req-9a88455a-75cd-4114-a86c-a324669609a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2939ac2-cfe5-449c-9134-331f6d917b68", "tag": "4e3a7e52-0222-4385-a9cc-7284b4ff51b7"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:24:21.008829 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-fb7c7480-43f9-438f-a0a7-2ccba2f0618d req-9a88455a-75cd-4114-a86c-a324669609a5 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:24:21.009268 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-fb7c7480-43f9-438f-a0a7-2ccba2f0618d req-9a88455a-75cd-4114-a86c-a324669609a5 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:24:21.020875 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-fb7c7480-43f9-438f-a0a7-2ccba2f0618d req-9a88455a-75cd-4114-a86c-a324669609a5 service nova] Creating event network-changed:4e3a7e52-0222-4385-a9cc-7284b4ff51b7 for instance f2939ac2-cfe5-449c-9134-331f6d917b68 on hv-cinder-84684 Jun 26 03:24:21.025990 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-fb7c7480-43f9-438f-a0a7-2ccba2f0618d req-9a88455a-75cd-4114-a86c-a324669609a5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029831 Jun 26 03:24:21.026639 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 626/1222] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:26:23.884670 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ab4b7b4-1408-4ff3-8571-99c76aa0b1d2] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 26 03:26:23.885955 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:26:23.886144 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-46190d12-3e26-40f6-879d-db06effcbea0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:26:23.886551 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-46190d12-3e26-40f6-879d-db06effcbea0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:26:23.887506 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG dbcounter [-] [117783] Writing DB stats nova_cell1:SELECT=48 {{(pid=117783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:26:23.889369 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_api:SELECT=20 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:26:23.890434 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG dbcounter [-] [117782] Writing DB stats nova_cell1:SELECT=44 {{(pid=117782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:26:23.892997 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-f3f3220b-ff50-47ff-9379-12a2e46eeafe req-79aa3da9-1b42-4264-a6ec-985d44e632ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2939ac2-cfe5-449c-9134-331f6d917b68", "tag": "4e3a7e52-0222-4385-a9cc-7284b4ff51b7"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:26:23.896609 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-46190d12-3e26-40f6-879d-db06effcbea0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:23.897133 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-46190d12-3e26-40f6-879d-db06effcbea0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:23.898188 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-46190d12-3e26-40f6-879d-db06effcbea0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:23.898652 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-46190d12-3e26-40f6-879d-db06effcbea0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:23.902911 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-f3f3220b-ff50-47ff-9379-12a2e46eeafe req-79aa3da9-1b42-4264-a6ec-985d44e632ef service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:23.903989 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-f3f3220b-ff50-47ff-9379-12a2e46eeafe req-79aa3da9-1b42-4264-a6ec-985d44e632ef service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:23.916082 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-f3f3220b-ff50-47ff-9379-12a2e46eeafe req-79aa3da9-1b42-4264-a6ec-985d44e632ef service nova] Creating event network-changed:4e3a7e52-0222-4385-a9cc-7284b4ff51b7 for instance f2939ac2-cfe5-449c-9134-331f6d917b68 on hv-cinder-84684 Jun 26 03:26:23.921389 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-f3f3220b-ff50-47ff-9379-12a2e46eeafe req-79aa3da9-1b42-4264-a6ec-985d44e632ef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038857 Jun 26 03:26:23.922348 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 627/1223] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:26:23.926135 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-46190d12-3e26-40f6-879d-db06effcbea0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Going to try to terminate instance {{(pid=117782) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:26:23.989823 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR oslo.messaging._drivers.impl_rabbit [None req-46190d12-3e26-40f6-879d-db06effcbea0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [2c0fa71c-8aab-45ac-961a-7e876c084b88] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 26 03:26:24.996967 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO oslo.messaging._drivers.impl_rabbit [None req-46190d12-3e26-40f6-879d-db06effcbea0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [2c0fa71c-8aab-45ac-961a-7e876c084b88] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 32968. Jun 26 03:26:25.018025 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-46190d12-3e26-40f6-879d-db06effcbea0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 204 len: 0 microversion: 2.1 time: 1.138591 Jun 26 03:26:25.018654 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 597/1224] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:26:23 2022] DELETE /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 0 bytes in 1140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:26:25.029746 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-9539995b-dab3-4b71-afd2-656691b0ee58 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:26:25.030481 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-9539995b-dab3-4b71-afd2-656691b0ee58 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:26:25.037356 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9539995b-dab3-4b71-afd2-656691b0ee58 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:25.037818 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9539995b-dab3-4b71-afd2-656691b0ee58 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:25.038624 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9539995b-dab3-4b71-afd2-656691b0ee58 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:25.039066 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-9539995b-dab3-4b71-afd2-656691b0ee58 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:25.054244 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ab4b7b4-1408-4ff3-8571-99c76aa0b1d2] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 32972. Jun 26 03:26:25.264342 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-9539995b-dab3-4b71-afd2-656691b0ee58 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:26:25.271694 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-9539995b-dab3-4b71-afd2-656691b0ee58 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1456 microversion: 2.1 time: 0.247287 Jun 26 03:26:25.272248 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 628/1225] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:26:25 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1456 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:26:26.290058 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-8a4cef4a-a1fc-4900-89d5-b50d67ecc75c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:26:26.290767 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-8a4cef4a-a1fc-4900-89d5-b50d67ecc75c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:26:26.297992 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8a4cef4a-a1fc-4900-89d5-b50d67ecc75c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:26.298471 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8a4cef4a-a1fc-4900-89d5-b50d67ecc75c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:26.299242 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8a4cef4a-a1fc-4900-89d5-b50d67ecc75c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:26.299684 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-8a4cef4a-a1fc-4900-89d5-b50d67ecc75c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:26.729065 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-8a4cef4a-a1fc-4900-89d5-b50d67ecc75c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:26:26.736717 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-8a4cef4a-a1fc-4900-89d5-b50d67ecc75c tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1456 microversion: 2.1 time: 0.451691 Jun 26 03:26:26.737282 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 598/1226] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:26:26 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1456 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:26:27.421349 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-3b147112-90d3-4d66-b68f-5fca2e941d35 req-43683ab7-f7d2-410e-99c6-8f4d42b6c23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2939ac2-cfe5-449c-9134-331f6d917b68", "name": "network-vif-deleted", "tag": "4e3a7e52-0222-4385-a9cc-7284b4ff51b7"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:26:27.429963 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-3b147112-90d3-4d66-b68f-5fca2e941d35 req-43683ab7-f7d2-410e-99c6-8f4d42b6c23d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:27.430439 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-3b147112-90d3-4d66-b68f-5fca2e941d35 req-43683ab7-f7d2-410e-99c6-8f4d42b6c23d service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:27.441171 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-3b147112-90d3-4d66-b68f-5fca2e941d35 req-43683ab7-f7d2-410e-99c6-8f4d42b6c23d service nova] Creating event network-vif-deleted:4e3a7e52-0222-4385-a9cc-7284b4ff51b7 for instance f2939ac2-cfe5-449c-9134-331f6d917b68 on hv-cinder-84684 Jun 26 03:26:27.446006 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-3b147112-90d3-4d66-b68f-5fca2e941d35 req-43683ab7-f7d2-410e-99c6-8f4d42b6c23d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028253 Jun 26 03:26:27.446615 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 629/1227] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:26:27.754125 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-ba734fc6-873f-4039-875e-5d3c8f4694d9 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:26:27.754775 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-ba734fc6-873f-4039-875e-5d3c8f4694d9 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:26:27.761335 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ba734fc6-873f-4039-875e-5d3c8f4694d9 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:27.762078 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ba734fc6-873f-4039-875e-5d3c8f4694d9 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:27.763226 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ba734fc6-873f-4039-875e-5d3c8f4694d9 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:27.763681 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-ba734fc6-873f-4039-875e-5d3c8f4694d9 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:27.831659 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-ba734fc6-873f-4039-875e-5d3c8f4694d9 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:26:27.841381 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-ba734fc6-873f-4039-875e-5d3c8f4694d9 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 200 len: 1225 microversion: 2.1 time: 0.091134 Jun 26 03:26:27.842118 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 599/1228] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:26:27 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:26:28.858891 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-539892c6-5435-4542-8f7a-abdfb24293a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:26:28.859592 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-539892c6-5435-4542-8f7a-abdfb24293a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: f2939ac2-cfe5-449c-9134-331f6d917b68] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:26:28.866447 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-539892c6-5435-4542-8f7a-abdfb24293a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:28.866901 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-539892c6-5435-4542-8f7a-abdfb24293a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:28.867673 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-539892c6-5435-4542-8f7a-abdfb24293a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:28.868642 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-539892c6-5435-4542-8f7a-abdfb24293a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:28.881885 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-539892c6-5435-4542-8f7a-abdfb24293a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] HTTP exception thrown: Instance f2939ac2-cfe5-449c-9134-331f6d917b68 could not be found. Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-539892c6-5435-4542-8f7a-abdfb24293a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Request method failure captured: Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 HTTP/1.1 Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit9AMUUoEE9l4NM5-hXozBivMZZl5AutZYdCaDs_-O45Hf0LHKCI0hoF577yn1cjmKvgQeAi4B-adWFpPMAxnQj23kl5K7Mp7pQY5ZniXM1GONPS9OycL-dNLoqtxs4nXc8DxVcprGFbi7AI-2MTUbShvHIbcx_G5Nxnvbi8-nzlUc2g Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 4a6b41994f444cafb21d3d6e395b6893 Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:26:28.883566 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:26:28.885366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a6b41994f444cafb21d3d6e395b6893"}]}] Jun 26 03:26:28.885366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:26:28.885366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 4a6b41994f444cafb21d3d6e395b6893 Jun 26 03:26:28.885366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:26:28.885366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-TestVolumeBootPattern-1214054101-project Jun 26 03:26:28.885366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:26:28.885366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:26:28.885366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 6d52b7f924f24f518ad0c9dfb6008260 Jun 26 03:26:28.885366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-TestVolumeBootPattern-1214054101-project Jun 26 03:26:28.885366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:26:28.885366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance f2939ac2-cfe5-449c-9134-331f6d917b68 could not be found. Jun 26 03:26:28.885366 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': 'f2939ac2-cfe5-449c-9134-331f6d917b68'} Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2939ac2-cfe5-449c-9134-331f6d917b68 could not be found. Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:26:28.886315 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2939ac2-cfe5-449c-9134-331f6d917b68 could not be found. Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2939ac2-cfe5-449c-9134-331f6d917b68 could not be found. Jun 26 03:26:28.888369 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:28.889991 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-539892c6-5435-4542-8f7a-abdfb24293a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Returning 404 to user: Instance f2939ac2-cfe5-449c-9134-331f6d917b68 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:26:28.889991 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-539892c6-5435-4542-8f7a-abdfb24293a8 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68" status: 404 len: 111 microversion: 2.1 time: 0.030204 Jun 26 03:26:28.889991 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 630/1229] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:26:28 2022] GET /compute/v2.1/servers/f2939ac2-cfe5-449c-9134-331f6d917b68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:26:31.917013 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-1a60be9a-87c4-457b-9de2-8185843b99cc tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:26:31.917532 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1a60be9a-87c4-457b-9de2-8185843b99cc tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:26:31.919300 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-55d31c68-95fc-4b36-ab38-6d88591d67e6 req-1817ebb7-c291-47f9-b5eb-a6060c3a491c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dade65a2-3652-4abe-b2f1-9c32b95f8c41", "tag": "0899d680-8642-43f4-878d-b695cd950eea"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:26:31.924113 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1a60be9a-87c4-457b-9de2-8185843b99cc tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:31.924824 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1a60be9a-87c4-457b-9de2-8185843b99cc tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:31.925590 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1a60be9a-87c4-457b-9de2-8185843b99cc tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:31.926020 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-1a60be9a-87c4-457b-9de2-8185843b99cc tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:31.928103 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-55d31c68-95fc-4b36-ab38-6d88591d67e6 req-1817ebb7-c291-47f9-b5eb-a6060c3a491c service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:31.928824 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-55d31c68-95fc-4b36-ab38-6d88591d67e6 req-1817ebb7-c291-47f9-b5eb-a6060c3a491c service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:31.943606 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-55d31c68-95fc-4b36-ab38-6d88591d67e6 req-1817ebb7-c291-47f9-b5eb-a6060c3a491c service nova] Creating event network-changed:0899d680-8642-43f4-878d-b695cd950eea for instance dade65a2-3652-4abe-b2f1-9c32b95f8c41 on hv-cinder-84684 Jun 26 03:26:31.949054 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-55d31c68-95fc-4b36-ab38-6d88591d67e6 req-1817ebb7-c291-47f9-b5eb-a6060c3a491c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033481 Jun 26 03:26:31.950066 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 631/1230] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 26 03:26:31.954197 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-1a60be9a-87c4-457b-9de2-8185843b99cc tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Going to try to terminate instance {{(pid=117782) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 26 03:26:32.040877 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-1a60be9a-87c4-457b-9de2-8185843b99cc tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 204 len: 0 microversion: 2.1 time: 0.127691 Jun 26 03:26:32.044748 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 600/1231] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:26:31 2022] DELETE /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 26 03:26:32.050279 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-7d088ec4-33d7-4e27-a49b-ae5ba103c5ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:26:32.050980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-7d088ec4-33d7-4e27-a49b-ae5ba103c5ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:26:32.057262 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7d088ec4-33d7-4e27-a49b-ae5ba103c5ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:32.057711 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7d088ec4-33d7-4e27-a49b-ae5ba103c5ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:32.058497 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7d088ec4-33d7-4e27-a49b-ae5ba103c5ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:32.058931 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-7d088ec4-33d7-4e27-a49b-ae5ba103c5ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:32.196252 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.policy [None req-7d088ec4-33d7-4e27-a49b-ae5ba103c5ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117783) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:26:32.204161 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-7d088ec4-33d7-4e27-a49b-ae5ba103c5ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1574 microversion: 2.1 time: 0.158000 Jun 26 03:26:32.204746 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 632/1232] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:26:32 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 26 03:26:33.221737 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-db0ebabd-ab0d-497d-88d5-3dbcb5836634 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:26:33.222492 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-db0ebabd-ab0d-497d-88d5-3dbcb5836634 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:26:33.229462 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-db0ebabd-ab0d-497d-88d5-3dbcb5836634 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:33.229912 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-db0ebabd-ab0d-497d-88d5-3dbcb5836634 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:33.230718 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-db0ebabd-ab0d-497d-88d5-3dbcb5836634 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:33.231159 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-db0ebabd-ab0d-497d-88d5-3dbcb5836634 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:33.392969 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-db0ebabd-ab0d-497d-88d5-3dbcb5836634 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:26:33.400835 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-db0ebabd-ab0d-497d-88d5-3dbcb5836634 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1574 microversion: 2.1 time: 0.183322 Jun 26 03:26:33.401400 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 601/1233] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:26:33 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:26:33.428524 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:26:33.428727 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Sun Jun 26 03:26:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:26:33.819612 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:26:33.820137 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Sun Jun 26 03:26:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:26:34.214740 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [req-38345000-39ba-43e1-b7e6-31dc6f22b464 req-6779b0e1-af02-4083-8c3b-3532f641bd57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dade65a2-3652-4abe-b2f1-9c32b95f8c41", "name": "network-vif-deleted", "tag": "0899d680-8642-43f4-878d-b695cd950eea"}]} {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 26 03:26:34.226245 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-38345000-39ba-43e1-b7e6-31dc6f22b464 req-6779b0e1-af02-4083-8c3b-3532f641bd57 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:34.226723 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [req-38345000-39ba-43e1-b7e6-31dc6f22b464 req-6779b0e1-af02-4083-8c3b-3532f641bd57 service nova] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:34.238714 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.compute.server_external_events [req-38345000-39ba-43e1-b7e6-31dc6f22b464 req-6779b0e1-af02-4083-8c3b-3532f641bd57 service nova] Creating event network-vif-deleted:0899d680-8642-43f4-878d-b695cd950eea for instance dade65a2-3652-4abe-b2f1-9c32b95f8c41 on hv-cinder-84684 Jun 26 03:26:34.244828 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [req-38345000-39ba-43e1-b7e6-31dc6f22b464 req-6779b0e1-af02-4083-8c3b-3532f641bd57 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033551 Jun 26 03:26:34.245629 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 633/1234] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Jun 26 03:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 26 03:26:34.385371 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:26:34.385545 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Sun Jun 26 03:26:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:26:34.417456 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-d51d40c8-d09e-4ccb-929b-ef2b25e8275e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:26:34.418091 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-d51d40c8-d09e-4ccb-929b-ef2b25e8275e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:26:34.424671 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d51d40c8-d09e-4ccb-929b-ef2b25e8275e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:34.425068 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d51d40c8-d09e-4ccb-929b-ef2b25e8275e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:34.425822 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d51d40c8-d09e-4ccb-929b-ef2b25e8275e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:34.426285 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-d51d40c8-d09e-4ccb-929b-ef2b25e8275e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:34.487622 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.policy [None req-d51d40c8-d09e-4ccb-929b-ef2b25e8275e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d52b7f924f24f518ad0c9dfb6008260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6b41994f444cafb21d3d6e395b6893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117782) authorize /opt/stack/nova/nova/policy.py:199}} Jun 26 03:26:34.495937 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-d51d40c8-d09e-4ccb-929b-ef2b25e8275e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 200 len: 1225 microversion: 2.1 time: 0.082147 Jun 26 03:26:34.496516 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 602/1235] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:26:34 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 26 03:26:35.513201 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-953be61e-b38f-47e0-980e-5cbc4864b8ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:26:35.513824 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-953be61e-b38f-47e0-980e-5cbc4864b8ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: dade65a2-3652-4abe-b2f1-9c32b95f8c41] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:26:35.520529 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-953be61e-b38f-47e0-980e-5cbc4864b8ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:35.521609 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-953be61e-b38f-47e0-980e-5cbc4864b8ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:35.522405 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-953be61e-b38f-47e0-980e-5cbc4864b8ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:35.522845 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-953be61e-b38f-47e0-980e-5cbc4864b8ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:35.535561 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-953be61e-b38f-47e0-980e-5cbc4864b8ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] HTTP exception thrown: Instance dade65a2-3652-4abe-b2f1-9c32b95f8c41 could not be found. Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-953be61e-b38f-47e0-980e-5cbc4864b8ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Request method failure captured: Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 HTTP/1.1 Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit9AMUUoEE9l4NM5-hXozBivMZZl5AutZYdCaDs_-O45Hf0LHKCI0hoF577yn1cjmKvgQeAi4B-adWFpPMAxnQj23kl5K7Mp7pQY5ZniXM1GONPS9OycL-dNLoqtxs4nXc8DxVcprGFbi7AI-2MTUbShvHIbcx_G5Nxnvbi8-nzlUc2g Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 4a6b41994f444cafb21d3d6e395b6893 Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:26:35.537134 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:26:35.538890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a6b41994f444cafb21d3d6e395b6893"}]}] Jun 26 03:26:35.538890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:26:35.538890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 4a6b41994f444cafb21d3d6e395b6893 Jun 26 03:26:35.538890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:26:35.538890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-TestVolumeBootPattern-1214054101-project Jun 26 03:26:35.538890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:26:35.538890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:26:35.538890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 6d52b7f924f24f518ad0c9dfb6008260 Jun 26 03:26:35.538890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-TestVolumeBootPattern-1214054101-project Jun 26 03:26:35.538890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:26:35.538890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance dade65a2-3652-4abe-b2f1-9c32b95f8c41 could not be found. Jun 26 03:26:35.538890 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': 'dade65a2-3652-4abe-b2f1-9c32b95f8c41'} Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dade65a2-3652-4abe-b2f1-9c32b95f8c41 could not be found. Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:26:35.539936 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dade65a2-3652-4abe-b2f1-9c32b95f8c41 could not be found. Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dade65a2-3652-4abe-b2f1-9c32b95f8c41 could not be found. Jun 26 03:26:35.541547 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:35.543294 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-953be61e-b38f-47e0-980e-5cbc4864b8ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Returning 404 to user: Instance dade65a2-3652-4abe-b2f1-9c32b95f8c41 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:26:35.543294 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-953be61e-b38f-47e0-980e-5cbc4864b8ee tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41" status: 404 len: 111 microversion: 2.1 time: 0.029828 Jun 26 03:26:35.543294 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 634/1236] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:26:35 2022] GET /compute/v2.1/servers/dade65a2-3652-4abe-b2f1-9c32b95f8c41 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:26:35.968512 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c87268a4-c0da-4dde-ae99-85aab281877e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:26:35.969005 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.compute.api [None req-c87268a4-c0da-4dde-ae99-85aab281877e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117782) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:26:35.975361 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c87268a4-c0da-4dde-ae99-85aab281877e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:35.975792 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c87268a4-c0da-4dde-ae99-85aab281877e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:35.976544 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c87268a4-c0da-4dde-ae99-85aab281877e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:35.976977 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG oslo_concurrency.lockutils [None req-c87268a4-c0da-4dde-ae99-85aab281877e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:35.990790 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.wsgi [None req-c87268a4-c0da-4dde-ae99-85aab281877e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] HTTP exception thrown: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c87268a4-c0da-4dde-ae99-85aab281877e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Request method failure captured: Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: request: DELETE /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 HTTP/1.1 Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept: application/json Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Accept-Encoding: identity Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Connection: close Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Length: 0 Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Content-Type: application/json Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Host: 10.222.0.13 Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Openstack-System-Scope: None Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: User-Agent: python-urllib3/1.26.9 Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Auth-Token: gAAAAABit9AMUUoEE9l4NM5-hXozBivMZZl5AutZYdCaDs_-O45Hf0LHKCI0hoF577yn1cjmKvgQeAi4B-adWFpPMAxnQj23kl5K7Mp7pQY5ZniXM1GONPS9OycL-dNLoqtxs4nXc8DxVcprGFbi7AI-2MTUbShvHIbcx_G5Nxnvbi8-nzlUc2g Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Id: None Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Domain-Name: None Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Identity-Status: Confirmed Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Is-Admin-Project: True Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Id: default Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Domain-Name: Default Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Id: 4a6b41994f444cafb21d3d6e395b6893 Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Project-Name: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Role: member,reader Jun 26 03:26:35.992407 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Roles: member,reader Jun 26 03:26:35.994206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a6b41994f444cafb21d3d6e395b6893"}]}] Jun 26 03:26:35.994206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:26:35.994206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Id: 4a6b41994f444cafb21d3d6e395b6893 Jun 26 03:26:35.994206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:26:35.994206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User: tempest-TestVolumeBootPattern-1214054101-project Jun 26 03:26:35.994206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Id: default Jun 26 03:26:35.994206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Domain-Name: Default Jun 26 03:26:35.994206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Id: 6d52b7f924f24f518ad0c9dfb6008260 Jun 26 03:26:35.994206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: X-User-Name: tempest-TestVolumeBootPattern-1214054101-project Jun 26 03:26:35.994206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: method: > Jun 26 03:26:35.994206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: exception: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:26:35.994206 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: action_args: {'id': '8b1ffc28-1390-49e3-89a2-0e9d284b2321'} Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:26:35.995173 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:26:35.996771 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: ERROR nova.api.openstack.wsgi Jun 26 03:26:35.998357 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-c87268a4-c0da-4dde-ae99-85aab281877e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Returning 404 to user: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. {{(pid=117782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:26:35.998357 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-c87268a4-c0da-4dde-ae99-85aab281877e tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 404 len: 111 microversion: 2.1 time: 0.029178 Jun 26 03:26:35.998357 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 603/1237] 10.222.0.13 () {58 vars in 1238 bytes} [Sun Jun 26 03:26:35 2022] DELETE /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:26:36.002205 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b9181705-f222-4376-9aea-763a3f199994 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '>' {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:26:36.002874 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.compute.api [None req-b9181705-f222-4376-9aea-763a3f199994 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] [instance: 8b1ffc28-1390-49e3-89a2-0e9d284b2321] Fetching instance by UUID {{(pid=117783) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 26 03:26:36.009376 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b9181705-f222-4376-9aea-763a3f199994 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:36.009827 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b9181705-f222-4376-9aea-763a3f199994 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:36.010608 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b9181705-f222-4376-9aea-763a3f199994 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 26 03:26:36.011316 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG oslo_concurrency.lockutils [None req-b9181705-f222-4376-9aea-763a3f199994 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Lock "025aa3fa-78c7-46e8-960a-ec1720423979" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 26 03:26:36.024669 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.wsgi [None req-b9181705-f222-4376-9aea-763a3f199994 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] HTTP exception thrown: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b9181705-f222-4376-9aea-763a3f199994 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Request method failure captured: Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: request: GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 HTTP/1.1 Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept: application/json Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Accept-Encoding: identity Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Connection: close Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Length: 0 Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Content-Type: application/json Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Host: 10.222.0.13 Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Openstack-System-Scope: None Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: User-Agent: python-urllib3/1.26.9 Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Auth-Token: gAAAAABit9AMUUoEE9l4NM5-hXozBivMZZl5AutZYdCaDs_-O45Hf0LHKCI0hoF577yn1cjmKvgQeAi4B-adWFpPMAxnQj23kl5K7Mp7pQY5ZniXM1GONPS9OycL-dNLoqtxs4nXc8DxVcprGFbi7AI-2MTUbShvHIbcx_G5Nxnvbi8-nzlUc2g Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Id: None Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Domain-Name: None Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Identity-Status: Confirmed Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Is-Admin-Project: True Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Id: default Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Domain-Name: Default Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Id: 4a6b41994f444cafb21d3d6e395b6893 Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Project-Name: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Role: member,reader Jun 26 03:26:36.026211 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Roles: member,reader Jun 26 03:26:36.027980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a6b41994f444cafb21d3d6e395b6893"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a6b41994f444cafb21d3d6e395b6893"}]}] Jun 26 03:26:36.027980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:26:36.027980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Id: 4a6b41994f444cafb21d3d6e395b6893 Jun 26 03:26:36.027980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214054101 Jun 26 03:26:36.027980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User: tempest-TestVolumeBootPattern-1214054101-project Jun 26 03:26:36.027980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Id: default Jun 26 03:26:36.027980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Domain-Name: Default Jun 26 03:26:36.027980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Id: 6d52b7f924f24f518ad0c9dfb6008260 Jun 26 03:26:36.027980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: X-User-Name: tempest-TestVolumeBootPattern-1214054101-project Jun 26 03:26:36.027980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: method: > Jun 26 03:26:36.027980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: exception: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:26:36.027980 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: action_args: {'id': '8b1ffc28-1390-49e3-89a2-0e9d284b2321'} Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: {{(pid=117783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 26 03:26:36.029089 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. Jun 26 03:26:36.030781 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: ERROR nova.api.openstack.wsgi Jun 26 03:26:36.032303 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: DEBUG nova.api.openstack.wsgi [None req-b9181705-f222-4376-9aea-763a3f199994 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Returning 404 to user: Instance 8b1ffc28-1390-49e3-89a2-0e9d284b2321 could not be found. {{(pid=117783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 26 03:26:36.032303 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO nova.api.openstack.requestlog [None req-b9181705-f222-4376-9aea-763a3f199994 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321" status: 404 len: 111 microversion: 2.1 time: 0.029276 Jun 26 03:26:36.032303 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: [pid: 117783|app: 0|req: 635/1238] 10.222.0.13 () {58 vars in 1235 bytes} [Sun Jun 26 03:26:35 2022] GET /compute/v2.1/servers/8b1ffc28-1390-49e3-89a2-0e9d284b2321 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 26 03:26:37.315824 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: DEBUG nova.api.openstack.wsgi [None req-fafe309a-7f36-47c9-91d7-e3bffb700ac0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] Calling method '.version_select at 0x7f582c047f70>' {{(pid=117782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 26 03:26:37.339411 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO nova.api.openstack.requestlog [None req-fafe309a-7f36-47c9-91d7-e3bffb700ac0 tempest-TestVolumeBootPattern-1214054101 tempest-TestVolumeBootPattern-1214054101-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2006413388" status: 202 len: 0 microversion: 2.1 time: 0.027678 Jun 26 03:26:37.339926 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: [pid: 117782|app: 0|req: 604/1239] 10.222.0.13 () {58 vars in 1262 bytes} [Sun Jun 26 03:26:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2006413388 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 26 03:29:42.744739 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:29:42.745474 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Sun Jun 26 03:29:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:29:53.438183 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:29:53.438829 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Sun Jun 26 03:29:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:29:53.827694 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:29:53.828249 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Sun Jun 26 03:29:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:29:54.393476 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:29:54.393712 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Sun Jun 26 03:29:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:32:03.414001 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:32:03.415086 dv-cinder-846842-4-iscsi devstack@n-api.service[117782]: Sun Jun 26 03:32:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 26 03:32:06.889639 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 26 03:32:06.890097 dv-cinder-846842-4-iscsi devstack@n-api.service[117783]: Sun Jun 26 03:32:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!